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ABSTRACT 



The National Assessment of Educational Progress (NAEP) is 
the only nationally representative and continuing assessment of what students 
in the United States know and can do in various academic subjects. The 1996 
NAEP in mathematics assessed the current level of mathematical achievement as 
a mechanism for informing education reform. In 1996, 44 states, the District 
of Columbia, Guam, and the Department of Defense schools took part in the 
NAEP state mathematics assessment program. The NAEP 1996 state mathematics 
assessment was at grade 4 and grade 8, although grades 4, 8, and 12 were 
assessed at the national level . The 1996 state mathematics assessment covered 
the five content strands: (1) Number Sense, Properties, and Operations; (2) 

Measurement; (3) Geometry and Spatial Sense; (4) Data Analysis, Statistics, 
and Probability; and (5) Algebra and Functions. In Colorado, 2,609 students 
in 107 public schools and 174 students in 10 nonpublic schools were assessed 
at the fourth-grade level and 2,530 students in 108 public schools were 
assessed at the eighth-grade level. This report describes the mathematics 
proficiency of Colorado fourth- and eighth-grade students, compares their 
overall performance to students in the West region of the United States and 
the entire United States (using data from the NAEP national assessment) , 
presents the average proficiency for the five content strands, and summarizes 
the performance of subpopulations (gender, race/ethnicity, parents' 
educational level. Title I participation, and free/reduced lunch program 
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eligibility) . Results are also presented for nonpublic school students at 
grade 4 for the 1996 state mathematics assessment. To provide a context for 
the assessment data, participating students, their mathematics teachers, and 
principals completed questionnaires which focused on: school characteristics 
(attendance) ; instructional content (curriculum coverage, standards, amount 
of homework); delivery of mathematics instruction and its characteristics; 
use of technology in mathematics instruction; students* own views about 
mathematics; and conditions facilitating mathematics learning (hours of 
television watched, parental support, home influences) . On the NAEP fields of 
mathematics scales that range from 0 to 500, the average mathematics scale 
score for fourth grade students in Colorado was 226 compared to 222 
throughout the United States and the average mathematics scale score for 
eighth grade students in Colorado was 276 compared to 271 throughout the 
United States. The average mathematics scale score of fourth grade males did 
not differ significantly from that of females in either Colorado or the 
nation. The average mathematics scale score of eighth grade males was higher 
than that of females in Colorado; nationwide, however, the performance of 
males did not differ significantly from that of females. At the fourth grade. 
White students in Colorado had an average mathematics scale score that was 
higher than that of Black, Hispanic, and American Indian students but was not 
significantly different from that of Asian/Pacific Islander students. At the 
eighth grade. White students in Colorado had an average mathematics scale 
score that was higher than that of Black and Hispanic students but was not 
significantly different from that of Asian/Pacific Islander students. (ASK) 
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What is The Nation’s Report Card? 



THE NATION’S REPORT CARD, the National Assessment of Educational Progress (NAEP), is the only nationally representative and 
continuing assessment of what America’s students know and can do in various subject areas. Since 1969, assessments have been conducted 
periodically in reading, mathematics, science, writing, history/geography, and other fields. By making objective information on student 
performance available to jpolicymakers at the national, state, and local levels, NAEP is an integral part of our nation’s evaluation of the condition 
and progress of education. Only information related to academic achievement is collected under this program. NAEP guarantees the privacy of 
individual students and their families. 

NAEP is a congressionally mandated project of the National Center for Education Statistics, the U.S. Department of Education. The 
Commissioner of Education Statistics is responsible, by law, for carrying out the NAEP project through competitive awards to qualified 
organizations. NAEP reports directly to the Commissioner, who is also responsible for providing continuing reviews, including validation studies 
and solicitation of public comment, on NAEP’s conduct and usefulness. 

In 1988, Congress established the National Assessment Governing Board (NAGB) to formulate policy guidelines for NAEP. The Board is 
responsible for selecting the subject areas to be assessed from among those included in the National Education Goals; for setting appropriate 
student performance levels; for developing assessment objectives and test specifications through a national consensus approach; for designing the 
assessment methodology; for developing guidelines for reporting and disseminating NAEP results; for developing standards and procedures for 
interstate, regional, and national comparisons; for determining the appropriateness of test items and ensuring they are free from bias; and for 
taking actions to improve the form and use of the National Assessment. 
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jN^onitoring the performance of students in subjects such as mathematics is a 
key concern of the citizens, policy makers, and educators concerned with educational 
reform efforts. The 1996 National Assessment of Educational Progress (NAEP) in 
mathematics (as well as the two previous NAEP assessments in mathematics in 1990 
and 1992) assessed the current level of mathematical achievement as a mechanism for 
informing education reform. This report contains results for public school students only 
for those years in which Colorado participated and for which minimum participation rate 
guidelines were met. Results are also presented for nonpublic school students at grade 
4 for the 1996 state mathematics assessment. 

What Is NAEP? 

The National Assessment of Educational Progress (NAEP) is the only nationally 
representative and continuing assessment of what students in the United States know and 
can do in various academic subjects. NAEP is authorized by Congress and directed by 
the National Center for Education Statistics of the U.S. Department of Education. The 
National Assessment Governing Board (NAGB), an independent body, provides policy 
guidance for NAEP. 

Since its inception in 1969, NAEP’s mission has been to collect, analyze, and 
produce valid and reliable information about the academic performance of students in 
the United States in various learning areas. In 1990, the mission of NAEP was expanded 
to provide state-by-state results on academic achievement. Participation in the 
state-by-state NAEP is voluntary and has grown from 40 states and territories in 1990 
to 48 in 1996. 

NAEP has also become a valuable tool in tracking progress towards the National 
Education Goals. The subjects assessed by NAEP are those highlighted at the 1989 
Education Summit and later legislation.' The NAEP 1996 assessment in mathematics 
marks the third time the subject has been assessed with the new framework in the 1990s, 
enabling policy makers and educators to track mathematics achievement since the release 
of the National Council of Teachers of Mathematics (NCTM) Curriculum and 
Evaluation Standards for School Mathematic^ in 1989. 



' Executive Office of the President. National Goals for Education. (Washington. DC: Government Printing Office. 1990); 
Goals 2000: Educate America Act. Pub. L. No. 103-227 (1994). 
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National Council of Teachers of Mathematics. Curriculum and Evaluation Standards for School Mathematics. (Reston. 
VA: NCTM. 1989). 
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NAEP 1996 iVlathematics Assessment 

The NAEP mathematics assessment has been in constant evolution since its 
inception in 1973. Major changes took place in the 1990s to complement the 
Curriculum and Evaluation Standards for School Mathematics, that was published by the 
National Council of Teachers of Mathematics (NCTM) in 1989. The NAEP 1990 
mathematics assessment saw the inclusion of short constructed-response questions — 
questions that asked students to provide the answer they calculated for a numerical 
problem or to write a sentence or two describing the solution to a problem. Also added 
in 1990 were a number of questions on which students could use calculators, protractors, 
or rulers. 

In 1992 the assessment included an increased number of short 
constructed-response questions and, for the first time, contained extended 
constructed-response questions. Extended constructed-response questions required 
students to produce both a solution and a short paragraph describing the solution or its 
interpretation in the context of the task. As such, these questions served as indicators 
of students’ growth in the areas of reasoning, communication, and problem solving — 
important processes receiving heavy emphasis in the NGTM Standards. 

In 1996 the NAEP mathematics assessment continued to be revised, most notably 
by continuing to increase the use of constructed-response questions. In 1990, students 
spent about 30 percent of testing time on constructed-response questions. By 1992, this 
percentage had increased to 35 percent, and in 1996 it exceeded 50 percent of the time 
spent by students on the assessment. 

The 1996 assessment maintained the same five content strands used for the 1990 
and 1992 assessments — Number Sense, Properties, and Operations; Measurement; 
Geometry and Spatial Sense; Data Analysis, Statistics, and Probability; and Algebra and 
Functions. Two of these strands. Number Sense, Properties, and Operations and 
Geometry and Spatial Sense, were revised to reflect the NCTM Standards' emphases 
on developing and assessing students’ abilities to make sense of both number/operation 
and spatial settings. 

The changes made to the NAEP 1996 mathematics assessment refined and 
sharpened the assessment to reflect more adequately recent curricular emphases and 
objectives; to include what teachers, mathematicians, and measurement experts think 
should be in the assessment; and to maintain the connection with the 1990 and 1992 
assessments to permit the measurement of trends in student performance since 1990. 

Tables H.l and H.2 show the distribution of mathematics scores and the 
percentage of students at or above the Basic, Proficient, and Advanced achievement 
levels for fourth- and eighth-grade students attending public schools in Colorado in 
1996. 
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TABLE H.1 - GRADES 4 AND 8 


Distribution of Mathematics Scale Scores for Public School 
Students 


State Assessment 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



Grade 4 


























Colorado 


226 I 


:i.o) 


187 ( 


(2.1) 


207 ( 


(1.2) 


227 ( 


[ 1.5) 


247 ( 


(1.3) 


263 1 


(1.3) 


West 


219 I 


[2.1) 


177 ( 


(4.0) 


197 ( 


(2.0) 


220 1 


(2.9) 


240 1 


(2.6) 


259 1 


(2.1) 


Nation 


222 I 


: 1.0) 


160 1 


( 1.5) 


201 1 


(1.3) 


224 1 


[ 1.3) 


244 1 


( 1.0) 


261 1 


( 1.0) 


Grade 8 


























Colorado 


276 1 


:i.i) 


232 1 


(2.9) 


254 ( 


(1.3) 


277 1 


(1.3) 


299 1 


(1.4) 


317 ( 


( 1.3) 


West 


266 1 


[2.4) 


219 1 


(4.8) 


244 1 


(3.0) 


269 1 


(1.7) 


294 1 


(3.4) 


314 1 


(3.0) 


Nation 


271 I 


[1.2) 


222 1 


(2.0) 


247 ( 


(1.2) 


272 1 


(1.1) 


296 1 


(1.4) 


316 1 


(2.0) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 

SOURCE; National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 
Mathematics Assessment. 
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TABLE H.2 — GRADES 4 AND 8 


Percentage of Public School Students Attaining Mathematics 
Achievement Levels 


State Assessment 



Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below Basic 



Grade 4 










Colorado 


2 ( 0.3) 


22 ( 1.3) 


67 ( 1 .6) 


33 ( 1 .6) 


West 


2 ( 0.5) 


16 ( 1.6) 


57 ( 3.0) 


43 ( 3.0) 


Nation 


2 ( 0.3) 


20 ( 1.0) 


62 ( 1.4) 


36 ( 1 .4) 


Grade 8 










Colorado 


3 ( 0.5) 


25 ( 1 .3) 


67 ( 1.3) 


33 ( 1.3) 


West 


3 ( 0.6) 


21 ( 2.0) 


58 ( 2.4) 


42 ( 2.4) 


Nation 


4 ( 0.6) 


23 ( 1.2) 


61 ( 1.3) 


39 ( 1.3) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of ^ucational Progress (NAEP), 1996 

Mathematics Assessment. 



li 



THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



3 



Colorado 



Major Findings for Coiorado 

• The average mathematics scale score for fourth graders in Colorado was 
226.^ This average was higher than that for the nation (222). 

• In terms of achievement levels established for the NAEP mathematics 
assessment, 22 percent of the fourth-grade students in Colorado 
performed at or above the Proficient level.“ This percentage did not 
differ significantly from that of students nationwide (20 percent). 

« From 1992 to 1996 in grade 4, there was an increase in the average scale 
score of students both in Colorado and across the nation. The observed 
increase for Colorado was not significantly different from the increase 
for the nation. 

• The average mathematics scale score for eighth graders in Colorado was 
276. This average was higher than that for the nation (271). 

• In terms of achievement levels, 25 percent of the eighth-grade students 
in Colorado performed at or above the Proficient level. This percentage 
did not differ significantly from that of students nationwide 
(23 percent). 

• From 1992 to 1996 for eighth graders, there was somewhat of an 
increase in the average scale score of students both in Colorado and 
across the nation. The observed increase for Colorado was not 
significantly different from the increase for the nation. 

• The average scale score for eighth graders in Colorado in 1996 (276) 
was higher than that in 1990 (267). 
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The NAEP mathematics scale ranges from 0 to 500. 

4 

The Proficient achievement level represents solid academic performance for each grade assessed. Students reaching this 
level have demonstrated competency over challenging subject matter, including subject-matter knowledge, application 
of such knowledge to real-world situations, and analytical skills appropriate to the subject matter. 
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Major Findings for Student Subpopuiations 

The preceding section provided a global view of the mathematics performance of 
fourth- and eighth-grade students in Colorado. It is also important to examine the 
average performance of subgroups within these populations. Typically, NAEP presents 
results for demographic subgroups defined by gender, race/ethnicity, parental education, 
and location of the school. In addition, in 1996 NAEP collected information on student 
participation in Title I programs and eligibility for the free/reduced-price lunch 
component of the National School Lunch Program (NSLP). 

The 1996 state assessment in mathematics also continued a component first 
introduced with the NAEP 1994 state assessment in reading — assessment of a 
representative sample of nonpublic school students. 

The reader is cautioned against using NAEP results to make simple or causal 
inferences related to subgroup membership. Differences among groups of students are 
almost certainly associated with a broad range of socioeconomic and educational factors 
not discussed in NAEP reports and possibly not addressed by the NAEP assessment 
program. 

Results for 1996 related to gender and race/ethnicity are highlighted below. A 
comparison of public and nonpublic school results is also presented. More complete 
results for the various demographic subgroups examined by the NAEP mathematics 
assessment can be found in Chapters 2 and 4 of this report, the NAEP 1996 Mathematics 
State Report for Colorado. 

• The average mathematics scale score of fourth-grade males did not differ 
significantly fi'om that of females in both Colorado and the nation. 

• The average mathematics scale score of eighth-grade males was higher / 
than that of females in Colorado; nationwide, however, the performance 

of males did not differ significantly from that of females. 

• At the fourth grade. White students in Colorado had an average 
mathematics scale score that was higher than that of Black, Hispanic, 
and American Indian students but was not significantly different from 
that of Asian/Pacific Islander students. 

• At the eighth grade. White students in Colorado had an average 
mathematics scale score that was higher than that of Black and Hispanic 
students but was not significantly different from that of Asian/Pacific 
Islander students. 

• In Colorado, the average scale score of public school fourth graders 
(226) was not significantly different from that of nonpublic school 
students (223). 
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Finding a Context for Understanding Students’ Mathematics 
Performance in Public Schools 

The mathematics performance of students in Colorado may be better understood 
when viewed in the context of the environment in which the students are learning. This 
educational environment is largely determined by school characteristics, by' 
characteristics of mathematics instruction in the school, by home support for academics 
and other home influences, and by the students’ own views about mathematics. 
Information about this environment is gathered by means of the questionnaires 
completed by principals and teachers as well as questions answered by students as part 
of the assessment. 

Because NAEP is administered to a sample of students that is representative of the 
fourth- and eighth-grade student populations in the schools of Colorado, NAEP results 
provide a view of the educational practices in Colorado which may be useful for 
improving instruction and setting policy. However, despite the richness of context 
provided by the NAEP results, it is very important to note that NAEP data cannot 
establish a cause-and-effect relationship between educational environment and student 
scores on the NAEP mathematics assessment. 

The following results are for public school students. 

School Characteristics Related to Student Performance ^ 

• The percentage of fourth-grade students in Colorado attending public 
schools that reported that mathematics was a priority (63 percent) was 
smaller than the national percentage (76 percent). 

• The percentage of Colorado eighth graders in public schools that 
reported that mathematics was a priority (69 percent) was not 
significantly different from that of students nationwide (74 percent). 

• The percentage of fourth graders attending public schools in Colorado 
that reported that absenteeism was a moderate to serious problem 
(11 percent) was not significantly different from that of fourth graders 
across the nation (13 percent). The percentage of students in Colorado 
public schools reporting that absenteeism was a moderate to serious 
problem did not change significantly* from 1992 (20 percent) to 1996 
(11 percent). 

• The percentage of eighth graders attending public schools in Colorado 
that reported absenteeism was a moderate to serious problem 
(20 percent) was not significantly different from that of eighth-grade 
students nationwide (25 percent). There was no significant change from 
1992 (24 percent) to 1996 (20 percent) in the percentage of eighth 
graders attending schools that reported that absenteeism was a moderate 
to serious problem. 




* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” 

^ More detailed results related to school characteristics can be found in Chapter 5 of this report, the NAEP 1996 
Mathematics State Report for Colorado. 
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Classroom Practices ^ 

• Relatively few of the fourth-grade students in Colorado (10 percent) had 
mathematics teachers who reported being very knowledgeable about the 
NCTM Standards. This percentage was smaller than the percentage 
whose teachers reported having little or no knowledge of the Standards 
(27 percent). 

• About one fifth of the eighth-grade students in Colorado (22 percent) 
had mathematics teachers who reported being very knowledgeable about 
the NCTM Standards. This percentage was greater than the percentage 
whose teachers reported having little or no knowledge of the Standards 
(11 percent). 

• In eighth grade, about one third of the students reported taking 
eighth-grade mathematics (34 percent), compared to 32 percent taking 
prealgebra and 28 percent taking algebra. The percentage of students 
taking algebra did not differ significantly from that for the nation 
(24 percent). 

• Less than half of the eighth- grade students expected to take prealgebra 

(9 percent) or algebra (30 percent) in the ninth grade. Another 

26 percent anticipated taking a geometry class. 

• The percentage of fourth graders in Colorado whose teachers reported 

spending four hours a week or more on mathematics instruction 

(66 percent) was not significantly different from the percentage for the 
nation (69 percent). The percentage for Colorado in 1996 did not differ 
significantly from the percentage in 1992 (63 percent). 

• The percentage of eighth graders in Colorado whose teachers reported 

spending four hours a week or more on mathematics instruction 

(26 percent) was not significantly different from* * the percentage for the 
nation (34 percent). The percentage for Colorado in 1996 did not differ 
significantly from the percentage in 1992 (27 percent). 

• Teachers of 45 percent of the fourth-grade students reported that they 
addressed the development of reasoning and analytical ability a lot. In 
contrast, 9 percent had teachers who reported spending little or no time 
addressing this topic. 

• Teachers of 45 percent of the eighth-grade students reported that they 
addressed the development of reasoning and analytical ability a lot. A 
small percentage of the students (8 percent) had teachers who reported 
spending little or no time addressing this topic. 




* Although the difference may appear large, recall that “significance” here refers to “statistical significance.”. 

* More detailed results related to classroom practices can be found in Chapter 6 of this report, the NAEP 1996 
Mathematics State Report for Colorado. 
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• According to their teachers, 9 percent of the fourth graders in Colorado 
were asked to write about solving a mathematics problem and 
33 percent were asked to discuss solutions with other students almost 
every day. By comparison, 24 percent were asked to write about and 
4 percent were asked to discuss mathematics solutions never or hardly 
ever. 

• According to their teachers, 5 percent of the eighth grade students in 
Colorado were asked to write about solving a mathematics problem and 
48 percent were asked to discuss solutions with other students almost 
every day. By comparison, 31 percent were asked to write about and 
3 percent were asked to discuss mathematics solutions never or hardly 
ever. 

• According to their teachers, 8 percent of the fourth graders in Colorado 
were not assigned any mathematics homework each day. In addition, a 
large majority of the students were assigned 15 minutes (57 percent) 
or 30 minutes (32 percent) of homework each day. 

• According to their teachers, 1 percent of the eighth graders in Colorado 
were not assigned any mathematics homework each day. In addition, 
about two thirds of the students were assigned 30 minutes (50 percent) 
or 45 minutes (19 percent) of homework each day. 

• About one third of the fourth graders in Colorado reported that there 
was no computer at home (35 percent) and another 3 1 percent reported 
never or hardly ever using their home computer to do homework. About 
one fifth of the students reported using a computer at home for 
homework almost every day (7 percent) or once or twice a week 
(13 percent). 

• Less than one third of the eighth-grade students reported that there was 
no computer at home (28 percent) and another 13 percent reported 
never or hardly ever using their home computer to do homework. Less 
than half of the students reported using a computer at home for 
homework almost every day (14 percent) or once or twice a week 
(24 percent). 

• About one third of the fourth graders in Colorado had teachers who 
reported that students used a calculator in mathematics class almost 
every day (5 percent) or once or twice a week (29 percent). About one 
fifth of the students never or hardly ever used a calculator (22 percent). 

• About three quarters of the eighth graders had teachers who reported that 
students used a calculator in mathematics class almost every day 
(56 percent) or once or twice a week (24 percent). Relatively few of 
the students never or hardly ever used a calculator (9 percent). 
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• More than half of the fourth graders (58 percent) said they discussed 
their school work at home almost every day. This percentage was larger 
than the percentage who said they never or hardly ever had such 
discussions (13 percent). 

• In Colorado, less than half of the eighth-grade students (44 percent) 
said they discussed their schoolwork at home almost every day. This 
percentage was larger than the percentage who said they never or hardly 
ever had such discussions (16 percent). 

• The percentage of fourth graders in Colorado who reported watching six 
or more hours of television a day (11 percent) was smaller than the 
percentage for the nation (20 percent). 

• The percentage of eighth graders in Colorado who reported watching six 
or more hours of television a day (9 percent) was smaller than the 
percentage for the nation (14 percent). 

• Overall, almost all of the fourth-grade students attended schools where 
principals characterized parental support as very positive (46 percent) 
or somewhat positive (51 percent). 

• Overall, almost all of the eighth-grade students attended schools where 
principals characterized parental support as very positive (48 percent) 
or somewhat positive (44 percent). 



17 



’ More detailed results related to influences beyond the school can be found in Chapter 7 of this report, the NAEP 1996 
Mathematics State Report for Colorado, 

THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 9 



Colorado 



INTRODUCTION 



Improving education is often seen as an important first step as the United States 
maps out a strategy to remain competitive in an ever-increasing global economy. 
Mathematics and science education continued to receive considerable attention at the 
1996 Governor’s Summit in Palisades, New Jersey, where the President and the 
governors reaffirmed the need to strengthen our schools and to strive for world-class 
standards. 

Monitoring the performance of students in subjects such as mathematics is a key 
concern of the state and national policy makers and educators who direct educational 
reform efforts. The 1996 National Assessment of Educational Progress (NAEP) in 
mathematics is a key source of information on what the nation’s students can do and 
how mathematics achievement has progressed during the 1990s. 



The NAEP assessment measures a mathematics domain containing five 
mathematics strands (number sense, properties, and operations; measurement; geometry 
and spatial sense; data analysis, statistics, and probability; and algebra and functions). 
Questions involving content from one or more of the strands are also categorized 
according to the domains of mathematical abilities and mathematical power. The first 
of these, mathematical abilities, describes the nature of the knowledge or processes 
involved in successfully handling the task presented by the question. It may reflect 
conceptual understanding, procedural knowledge, or a combination of both in problem 
solving. The second domain, mathematical power, reflects processes stressed as major 
goals of the mathematical curriculum. Mathematical power refers to the students’ ability 
to reason, to communicate, and to make connections of concepts and skills across 
mathematical strands, or from mathematics to other curricular areas. 



What Was Assessed? 
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The mathematics framework for the NAEP 1996 assessment is a revision of that 
used in the 1990 and 1992 assessments. Changes were made to the earlier framework 
in light of the NCTM Standards and changes taking place in school mathematics 
programs. The previous NAEP mathematics framework was refined and sharpened so 
that the 1996 assessment would: (1) more adequately reflect recent curricular emphases 
and objects and yet (2) maintain a connection with the 1990 and 1992 assessments to 
measure trends in student performance. Prior to the 1996 assessment, investigations 
were conducted to ensure that results from the assessment could be reported on the 
existing NAEP mathematics scale. The conclusion drawn from these investigations was 
that results from the 1990, 1992, and 1996 assessments could be reported on a common 
scale and trends in mathematics performance since 1990 examined. Appendix B briefly 
highlights selected changes in the current NAEP mathematics framework. 

The conception of mathematical power as reasoning, connections, and 
communication has played an increasingly important role in measuring student 
achievement. In 1990, the NAEP assessment included short constructed-response 
questions as a way to begin addressing mathematical communication. In 1992, the 
extended constructed-response questions included on the assessment required students 
not only to communicate their ideas but also to demonstrate the reasoning they used to 
solve problems. The 1996 assessment continued to emphasize mathematical power by 
including constructed-response questions focusing on reasoning and communication and 
by requiring students to connect their learning across mathematical content strands. 
These connections were addressed within individual questions reaching across content 
strands and by families of questions contained within a single content strand. 

In real life, few mathematical situations can be clearly classified as belonging to 
one content strand or another, and few situations require only one fact of mathematics 
thinking. Therefore, many of the questions are classified in a number of ways. In 
addition to being classified by all applicable content strands, each question was classified 
by its assessment of applicable mathematical abilities (procedural knowledge, conceptual 
understanding, and problem solving) and mathematical powers (reasoning, 
communication, and connections). The content strands, mathematical abilities, and 
mathematical power combine to form the firamework for the NAEP assessment. (A brief 
description of the five content strands is presented in Appendix B.) 
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The framework continued the shift from multiple-choice questions to questions 
that required students to construct responses. In 1996, more than 50 percent of student 
assessment time was devoted to constructed-response questions. Two types of 
constructed-response questions were included — (1) short constructed-response 
questions that required students to provide answers to computation problems or to 
describe solutions in one or two sentences, and (2) extended constructed-response 
questions that required students to provide longer responses when answering the 
questions. 

Who Was Assessed? 

Fourth- and Eighth-Grade School and Student Characteristics 

Tables I.IA and LIB provide profiles of the demographic characteristics of the 
fourth- and eighth-grade students in Colorado, the West region, and the nation. These 
profiles are based on data collected from the students and schools participating in the 
1992 and 1996 state and national mathematics assessments at grade 4 and the 1990, 
1992, and 1996 state and national mathematics assessments at grade 8. This report 
contains results for public school students only for those years in which Colorado 
participated and for which minimum participation rate guidelines were met. Results are 
also presented for nonpublic school students at grade 4 for the 1996 state mathematics 
assessment. As described in Appendix A, the state data and the regional and national 
data are drawn from separate samples. 

In 1996, approximately 93 percent of fourth graders in Colorado attended public 
schools, with the remaining students attending nonpublic schools (including Catholic and 
other private schools). For the nation, 89 percent of students at grade 4 attended public 
schools in 1996. 

To ensure comparability across jurisdictions, NCES has established guidelines for 
school and student participation rates. Appendix A highlights these guidelines, and 
Jurisdictions failing to meet these guidelines are noted in tables and figures in NAEP 
reports containing state-by-state results. For Jurisdictions failing to meet the initial 
school participation rate of 70 percent, results are not reported. 
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TABLE 1.1 A -GRADE 4 


Profile of Students in Colorado, the West Region, and the 


State Assessment 


Nation 





1992 


1996 


Demographic Subgroups 


Public 


Public 


Nonpublic 


Combined 




Percentage 



RACE/ETHNlCmr 

Colorado 


White 


68 1 


(1.5) 


69 1 


(1.6) 


64 (14.1) 


68 1 


[ 1.8) 




Black 


5 ( 


(1.0) 


4 ( 


[ 0.8) 


20 (****) 


5 ( 


[1.2) 




Hispanic 


22 1 


(1.3) 


21 1 


(1.3) ; 


13 (6.4) 


20 1 


[ 1.4) 




Asian/Pacific Islander 


3 1 


(0.3) 


4 1 


[ 0.5) . 


2 (****) 


3 ( 


[0.5) 




American Indian 


3 1 


(0.3) 


31 


[ 0.4) 


1 (****) 


3 ( 


[0.4) 


West 


White 


64 1 


(1.7) 


61 ( 


(2.4) 


57 (1 4.0) 


60 1 


[2.4) 




Black 


10 ( 


(1.7) 


10 ( 


(1.7) 


16 (****) 


10 ( 


[1.7) 




Hispanic 


17( 


(1.6) 


22 1 


[1.8) : 


17 ( 4.6) 


22 1 


[1.8) 




Asian/Pacific Islander 


5 ( 


(1.0) 


51 


[0.7) 


8 ( 3.3) 


5 1 


[0.7) 




American Indian 


2 ( 


(0.3) 


2( 


[ 0.4) 


1 (****) 


2 ( 


[0.4) 


Nation 


White 


69 1 


(0.4) 


66 1 


[ 0.6)< 


80 ( 4.0) 


68 1 


[0.4) 




Black 


17( 


(0.4) 


15 1 


[ 0.4) ; 


8(3.1) 


15 1 


[0.2) 




Hispanic 


101 


(0.2) 


14 1 


[o.4)> : 


7( 1.1) 


13 1 


[0.4) 




Asian/Pacific Islander 


3 1 


(0.3) 


3( 


[ 0.2) , 


3 ( 0.8) 


3 ( 


[0.2) 




American Indian 


21 


(0.2) 


21 


[ 0.2) : 


1 ( 0.3) 


2 1 


[0.2) 


TYPE OF LOCATION* 


















Colorado 


Central city 


33 1 


[3.2) 


39 1 


[ 3.2) i 


56 (19.2) 


41 1 


[3.3) 




Urban fringe/Large town 


46 1 


(3.9) 


41 1 


[ 3.4) j 


35 (19.6) 


40 1 


[3.5) 




Rural/Small town 


20 1 


(2.4) 


20 1 


[ 2.3) ; 


9 ( 4.6) 


19 1 


[2.1) 


Nation 


Central city 


32 1 


(3.0) 


28 1 


[ 2.9) ; 


49 ( 6.5) 


30 1 


[2.7) 




Urban fringe/Large town 


40 1 


[3.6) 


46 1 


[ 3.6) ; 


45 ( 6.8) 


46 1 


[3.2) 




Rural/Small town 


28 1 


(2.9) 


26 1 


[ 2.8) 1 


6 ( 2.5) 


24 ( 


[2.5) 


PARENTS^ EDUCATION 
Colorado 


Did not finish high school 


4 ( 


(0.3) 


31 


[ 0.4) j 


1 ( 0.7) 


3( 


[0.4) 




Graduated from high school 


10( 


(0.6) 


10 1 


[ 0.7) 1 


7 ( 3.0) 


10 1 


[0.7) 




Some education after high school 


9( 


(0.6) 


10 1 


[ 0.6) 1 


7 ( 3.6) 


91 


[0.6) 




Graduated from college 


40 1 


(1.0) 


42 1 


[1.6) : 


55 ( 7.5) 


43 1 


[1.6) 




1 don't know 


37 ( 


(1.2) 


35 1 


[1.5) ! 


29 ( 6.5) 


351 


[1.5) 


West 


Did not finish high school 


4 ( 


(0.5) 


4 ( 


[ 0.7) i 


1 (••••) 


4 1 


[0.7) 




Graduated from high school 


12 ( 


(1.0) 


11 ( 


[ 0.7) i 


4 ( 1.9) 


10 1 


[0.6) 




Some education after high school 


7( 


(1.0) 


7( 


[ 0.7) 1 


4 ( 1.9) 


71 


[0.7) 




Graduated from college 


38 1 


(1.9) 


34( 


[1.8) 


67 ( 5.4) 


36 1 


[1.7) 




1 don't know 


39 1 


(1.3) 


44 ( 


[ 2.2) ; 


23 ( 3.0) 


431 


[2.1) 


Nation 


Did not finish high school 


4 ( 


(0.3) 


4 ( 


[ 0.4) 1 


1 ( 0.3) 


4 ( 


[0.3) 




Graduated from high school 


13 ( 


(0.6) 


13 ( 


[ 0.7) i 


8 ( 0.9) 


13 ( 


[0.6) 




Some education after high school 


7( 


(0.4) 


7( 


[ 0.4) 1 


7(1.0) 


7( 


[0.4) 




Graduated from college 


40 1 


(1.1) 


38 1 


[1.2) 1 


58 ( 2.6) 


40 1 


[1.1) 




1 don't know 


36 1 


(0.8) 


37 ( 


[1.0) 1 


27 ( 1.9) 


36 1 


[1.0) 


GENDER 










1 








Colorado 


Male 


50 1 


(1.0) 


51 ( 


[ 0.8) i 


48 ( 3.4) 


51 ( 


[0.8) 




Female 


50 1 


(1.0) 


49 ( 


[ 0.8) j 


52 ( 3.4) 


49 1 


[0.8) 


West 


Male 


52 1 


(1.5) 


50 1 


[1.6) 1 


47 ( 2.4) 


50 1 


[1.5) 




Female 


48 1 


(1.5) 


50 1 


[1.6) i 


53 ( 2.4) 


50 1 


[ 1.5) 


Nation 


Male 


50 1 


(0.7) 


51 ( 


[ 0.7) 1 


51 ( 2.0) 


51 ( 


[0.7) 




Female 


50 1 


(0.7) 


49 1 


[ 0.7) I 


49 ( 2.0) 


49 1 


[0.7) 



(continued on next page) 
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TABLE 1.1 A — GRADE 4 (continued) 


Profile of Students in Colorado, the West Region, and the 
Nation 


State Assessment 





1992 


1996 


Demographic Subgroups 


Public 


Public 


Nonpublic 


Combined 




Percentage 



TITLE 1 
Colorado 


Participated 






7 ( 


(1.0) 


3 (“**) 


6 1 


(1.0) 




Did not participate 


... 




93 1 


(1.0) 


97 (****) 


94 1 


(1.0) 


West 


Participated 


... 




28 1 


(3.1) 


3 (****) 


27 1 


(3.1) 




Did not participate 


... 




72 ( 


(3.1) 


97 (****) 


73 1 


(3.1) 


Nation 


Participated 


... 




24 ( 


(1.5) 


5(1.9) 


22 1 


(1.4) 




Did not participate 


... 




761 


(1.5) 


95 ( 1.9) 


78 1 


(1.4) 


FREE/REDUCED-PRICE LUNCH 
















Colorado 


Eligible 


... 




29 4 


(1.7) 


8 (****) 


28 1 


(1.7) 




Not eligible 


... 




66 4 


(2.6) 


46 (18.8) 


65 1 


(2.7) 




Information not available 


... 




54 


(2.0) 


46 (19.8) 


8 1 


(2.4) 


West 


Eligible 


... 




35 4 


(3.2) 


3 (****) 


33 1 


(3.1) 




Not eligible 


... 




53 4 


(4.1) 


54 (15.5) 


53 1 


(3.9) 




Information not available 


... 




12 4 


(4.8) 


42 (17.0) 


14 ( 


(4.5) 


Nation 


Eligible 


... 




344 


(1.6) 


7(1.8) 


31 ( 


(1.4) 




Not eligible 


... 




52 4 


(2.5) 


54 ( 6.8) 


53 1 


(2.5) 




Information not available 


— 




134 


(3.1) 


39 ( 6.8) 


16 4 


(3.0) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 
at alx)ut the 95 percent confidence level. The percentages for Race/Ethnicity may not add to 1(X) percent because some 
students categorized themselves as “Other.” * Characteristics of the school sample do not permit reliable regional results 
for type of location. — Title I and Free/Reduced- Price Lunch results are not available for the 1992 assessment. 
**** Standard error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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TABLE UB- GRADE 8 


Profile of Students in Colorado, the West Region, and the 
Nation 


State Assessment 



Demographic Subgroups 


1990 


1992 


1996 


Public 


Percentage 



RACE/ETHNICmr 














Colorado 


White 


73 ( 1 .3) 


74 1 


(1.2) 


69 1 


[1.4) 




Black 


4(1.0) 


4( 


[0.6) 


51 


(0.9) 




Hispanic 


19 ( 1.6) 


18( 


[1.1) 


21 1 


[1.5) 




Asian/Pacific Islander 


2 ( 0.3) 


2( 


[0.3) 


■ 3| 


[0.3) 




American Indian 


2 ( 0.3) 


21 


[0.3) 


2| 


[0.4) 


Weat 


White 


63 ( 1.9) 


63 1 


[1.5) 


56 1 


[2.6) 




Black 


7 ( 2.0) 


6| 


(1.3) 


8| 


[1.9) 




Hispanic 


21 (1.5) 


21 ( 


(1.7) 


26 1 


[1.6) 




Asian/Pacific Islander 


4(1.3) 


5( 


(0.8) 


7| 


:i.i) 




American Indian 


4 ( 2.3) 


21 


(0.7) 


1 1 


[0.3) 


Nation 


White 


70 ( 0.5) 


691 


(0.4) 


66 1 


: 0.5)« 




Black 


16 ( 0.3) 


161 


(0.2) 


15 1 


: 0.4)< 




Hispanic 


10 ( 0.4) 


10( 


(0.3) 


131 


: o.3)»> 




Asian/Pacific Islander 


2 ( 0.5) 


2| 


(0.2) 


31 


(0.3) 




American Indian 


2 ( 0.7) 


1 ( 


(0.2) 


1 1 


(0.3) 


TYPE OF LOCATION* 














Colorado 


Central city 


... (..,) 


351 


(2.6) 


39 1 


(2.8) 




Urban fringe/Large town 


... (....) 


451 


(3.8) 


44| 


(3.9) 




Rural/Small town 


... (..,) 


19( 


(2.9) 


181 


(3.3) 


Nation 


Central city 


... (..,) 


301 


(2.8) 


29 1 


(2.7) 




Urban fringe/Large town 


... (..,) 


42 ( 


(3.8) 


36 1 


(3.4) 




Rural/Smaii town 


... (..,) 


261 


(3.1) 


33 1 


(3.1) 


PARENTS^ EDUCATION 














Colorado 


Did not finish high school 


7 ( 0.7) 


61 


(0.6) 


61 


(0.6) 




Graduated from high school 


19(0.9) 


21 ( 


(0.9) 


191 


(0.9) 




Some education after HS 


19(0.9) 


191 


(0.9) 


20 1 


(0.8) 




Graduated from college 


47(1.6) 


461 


(1.2) 


451 


(1.5) 




1 don't know 


B ( 0.6) 


7| 


(0.5) 


101 


: 0.7)> 


West 


Did not finish high school 


10 ( 1.3) 


9| 


(1.1) 


91 


(0.8) 




Graduated from high school 


19(2.5) 


191 


(1.5) 


20 1 


(1.2) 




Some education after HS 


16 ( 1.2) 


181 


(1.2) 


191 


(1.5) 




Graduated from college 


42 ( 4.0) 


431 


(2.9) 


361 


(2.2) 




i don't know 


13 ( 1.2) 


11 1 


(0.9) 


151 


[1.6) 


Nation 


Did not finish high school 


10 ( 0.8) 


61 


(0.6) 


8| 


(0.5) 




Graduated from high school 


25 ( 1.2) 


251 


(0.8) 


231 


(0.8) 




Some education after HS 


17 ( 0.9) 


18( 


(0.6) 


19 1 


(0.8) 




Graduated from college 


39 ( 1.9) 


401 


(1.4) 


40 1 


(1.4) 




i don't know 


9 ( 0.7) 


91 


(0.5) 


11 ( 


(0.6) 


GENDER 














Colorado 


Male 


51 ( 1.0) 


51 1 


(0.8) 


51 ( 


(1.0) 




Female 


49 ( 1 .0) 


49 1 


(0.8) 


491 


(1.0) 


West 


Male 


55(2.1) 


51 1 


(1.4) 


54( 


(1.3) 




Female 


45(2.1) 


49 1 


(1.4) 


461 


(1.3) 


Nation 


Male 


51 (1.1) 


52 1 


(0.6) 


52 1 


(0.9) 




Female 


49(1.1) 


46 1 


(0.6) 


46 1 


(0.9) 



(continued on next page) 
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TABLE LIB — GRADE 8 (continued) 


Profile of Students in Colorado, the West Region, and the 
Nation 


State Assessment 



Demographic Subgroups 


1990 


1992 


1996 


Public 


Percentage 



TrTLEI 

Colorado 


Participated 


... (....) 




(--■-) 


2l 


(0.7) 




Did not participate 


- 


... 


(--■-) 


98 1 


(0.7) 


West 


Participated 


... (....) 


... 




17 ( 


(3.5) 




Did not participate 


... (....) 


... 


(--■-) 


83 1 


(3.5) 


Nation 


Participated 


- (--■-) 


... 


(-■-) 


13 ( 


(1.8) 




Did not participate 


... (....) 


... 


(--■-) 


87 ( 


( 1.8) 


FREE/REDUCED-PRICE LUNCH 












Colorado 


Eligible 


... 


... 




24 ( 


(1.6) 




Not eligible 


- (-.-) 


... 




65 1 


(2.5) 




information not available 


... (....) 


... 




11 ( 


(2.3) 


West 


Eligible 


... (....) 


— 




30 1 


(2.7) 




Not eligible 


... (....) 


... 




48 1 


(4.1) 




information not available 


- 


... 




22 { 


(5.6) 


Nation 


Eligible 


- (”■■) 


... 




30 { 


(1.6) 




Not eligible 


... (....) 


... 




56 { 


(2.6) 




information not available 


... (..,) 


— 




14 1 


(3.1) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
» («) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1990 
at al^ut the 95 percent confidence level. If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. The percentages for 
Race/Ethnicity may not add to 100 percent because some students categorized themselves as “Other.” * Characteristics 
of the school sample do not permit reliable regional results for type of location. Type of location results are not 
available for the NAEP 1990 mathematics assessment, and Title I and Free/Reduced-Price Lunch results are not available 
for the 1990 and 1992 assessments. **** Standard error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990, 1992, 
and 1996 Mathematics Assessments. 
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Schools and Students Assessed 

Tables I.2A and I.2B summarize participation data for schools and students 
sampled in Colorado for the 1996 state assessment program in mathematics and previous 
NAEP state assessments in mathematics.® 

In Colorado, 107 public schools and 10 nonpublic schools participated in the 1996 
fourth-grade mathematics assessment. These numbers include participating substitute 
schools that were selected to replace some of the nonparticipating schools from the 
original sample. The weighted school participation rates after substitution in 1996 were 
99 percent for public schools and 76 percent for nonpublic schools, which means that 
the fourth-grade students in this sample were directly representative of 99 percent and 
76 percent of all the fourth-grade public and nonpublic school students, respectively, in 
Colorado. 

At the eighth grade, 108 public schools in Colorado participated in the 1996 
mathematics assessment. This number includes participating substitute schools that were 
selected to replace some of the nonparticipating schools from the original sample. The 
weighted school participation rate after substitution in 1996 was 100 percent for public 
schools, which means that the eighth-grade students in this sample were directly 
representative of 100 percent of all the eighth-grade public school students in Colorado. 

In each school, a random sample of students was selected to participate in the 
assessment. In 1996, on the basis of sample estimates, 4 percent of the fourth-grade 
public school population and 0 percent of the nonpublic school population were 
classified as students with limited English proficiency (LEP). At the eighth grade, 

2 percent of the public school population were classified as students with limited 
English proficiency. At the fourth grade, 13 percent of the students in public schools 
and 5 percent of the students in nonpublic schools had an Individualized Education Plan 
(lEP), and at the eighth grade, 10 percent of students in public schools had an lEP. 

An lEP is a plan written for a student who has been determined to be eligible for special 
education. The lEP typically sets forth goals and objectives for the student and describes 
a program of activities and/or related services necessary to achieve the goals and 
objectives. 
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For a detailed discussion of the NCES guidelines for sample participation, see Appendix A of this report or the 
Technical Report of the NAEP 1996 State Assessment Program in Mathematics. (Washington, DC: National Center for 
Education Statistics, 1997). 



18 



THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



Colorado 



Schools were permitted to exclude certain students from the assessment, provided 
that the following criteria were met. To be excluded, a student had to be categorized 
as LEP or had to have an lEP or equivalent and (in either case) be judged incapable of 
participating in the assessment. The intent was to assess all selected students; therefore, 
all selected students who were capable of participating in the assessment should have 
been assessed. However, schools were allowed to exclude those students who, in the 
judgment of school staff, could not meaningfully participate. The NAEP guidelines for 
exclusion are intended to assure uniformity of exclusion criteria from school to school. 
Note that some students classified as LEP and some students having an lEP were 
deemed eligible to participate and not excluded from the assessment. The students in 
Colorado who were excluded from the assessment because they were categorized as LEP 
or had an lEP represented 9 percent of the public school population and 5 percent of 
the nonpublic school population in grade 4 and 5 percent of the public school 
population in grade 8. 

In Colorado 2,609 public school and 174 nonpublic school fourth-grade students 
were assessed in 1996. The weighted student participation rates were 95 percent for 
public schools and 96 percent for nonpublic schools. This means that the sample of 
fourth-grade students who took part in the assessment was directly representative of 
95 percent of the eligible public school student population and 96 percent of the eligible 
nonpublic school student population in participating schools in Colorado (that is, all 
students from the population represented by the participating schools, minus those 
students excluded from the assessment). The overall weighted response rates (school 
rate times student rate) were 94 percent and 73 percent for public and nonpublic 
schools, respectively. This means that the sample of students who participated in the 
assessment was directly representative of 94 percent of the eligible fourth-grade public 
school population and 73 percent of the eligible fourth-grade nonpublic school 
population in Colorado. 

In Colorado 2,530 public school eighth-grade students were assessed in 1996. 

The weighted student participation rate was 91 percent for public schools. This means 
that the sample of eighth-grade students who took part in the assessment was directly 
representative of 91 percent of the eligible public school student population in 
participating schools in Colorado (that is, all students from the population represented 
by the participating schools, minus those students excluded from the assessment). The 
overall weighted response rate (school rate times student rate) was 91 percent for public 
schools. This means that the sample of students who participated in the assessment was 
directly representative of 91 percent of the eligible eighth-grade public school 
population in Colorado. 
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TABLE I.2A - GRADE 4 


Profile of the Population Assessed in Colorado 



1992 


1996 


Public 


Public 


Nonpublic 



SCHOOL PARTICIPATION 

Weighted school participation rate before substitution 


100% 


99% 


76% 


Weighted school participation rate after substitution 


100% 


99% 


76% 


Number of schools originally sampled 


123 


107 


15 


Number of schools not eligible 


2 


0 


2 


Number of schools in original sample participating 


121 


107 


10 


Number of substitute schools provided 


0 


0 


3 


Number of substitute schools participating 


0 


0 


0 


Total number of participating schools 


121 


107 


10 


STUDENT PARTICIPATION 

Weighted student participation rate after makeups 


95% 


95% 


96% 


Number of students selected to participate In the 
assessment 


3,368 


3,015 


188 


Number of students withdrawn from the assessment 


152 


124 


1 


Percentage of students who were of Limited English 
Proficiency 


2% 


4% 


0% 


Percentage of students excluded from the assessment 
due to Limited English Proficiency 


1% 


2% 


0% 


Percentage of students who had an Individualized 
Education Plan 


8% 


13% 


5% 


Percentage of students excluded from the assessment 
due to Individualized Education Plan status 


4% 


7% 


5% 


Number of students to be assessed 


3,050 


2,753 


183 


Number of students assessed 


2,906 


2,609 


174 


Overall weighted response rate 


95% 


94% 


73% 



Colorado failed to meet one or more established participation guidelines in 1996. See Appendix A for details. 
SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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TABLE I.2B - GRADE 8 


Profile of the Population Assessed in Colorado 


state Assessment 



1990 


1992 


1996 


Public 



SCHOOL PARTICIPATION 

Weighted school participation rate before substitution 


100% 


100% 


100% 


Weighted school participation rate after substitution 


100% 


100% 


100% 


Number of schools originally sampled 


107 


113 


109 


Number of schools not eligible 


2 


1 


1 


Number of schools in original sample participating 


105 


112 


108 


Number of substitute schools provided 


0 


0 


0 


Number of substitute schools participating 


0 


0 


0 


Total number of participating schools 


105 


112 


108 


STUDENT PARTICIPATION 

Weighted student participation rate after makeups 


94% 


93% 


91% 


Number of students selected to participate in the 
assessment 


3,177 


3,325 


3,035 


Number of students withdrawn from the assessment 


192 


183 


191 


Percentage of students who were of Limited English 
Proficiency 


1% 


1% 


2% 


Percentage of students excluded from the assessment 
due to Limited English Proficiency 


1% 


1% 


1% 


Percentage of students who had an Individualized 
Education Plan 


9% 


8% 


10% 


Percentage of students excluded from the assessment 
due to Individualized Education Plan status 


4% 


4% 


4% 


Number of students to be assessed 


2,843 


3,006 


2,782 


Number of students assessed 


2,675 


2,799 


2,530. 


Overall weighted response rate 


94% 


93% 


91% 
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In accordance with standard practice in survey research, the results presented in 
this report were based on calculations that incorporate adjustments for the 
nonparticipating schools and students. Hence, the final results derived from the sample 
provide estimates of the mathematics performance for the full population of eligible 
fourth- and eighth-grade students in Colorado. However, in instances where 
nonparticipation rates are large, these nonparticipation adjustments may not adequately 
compensate for the missing sample schools and students. 

In order to guard against potential nonparticipation bias in published results, the 
National Center for Education Statistics (NCES) has established minimum participation 
levels as a condition for the publication of 1996 state assessment program results. NCES 
also established additional guidelines addressing four ways in which nonparticipation 
bias could be introduced into a jurisdiction’s published results (see Appendix A). In 
1996 Colorado met minimum participation levels for public schools at grades 4 and 8 
and for nonpublic schools at grade 4. However, Colorado’s eighth-grade nonpublic 
schools did not participate in the 1996 state assessment. Hence, results for both types 
of schools are included in this report for grade 4 and for public schools at grade 8. 
Colorado met all other established NCES participation guidelines for public schools at 
grades 4 and 8 but failed to meet one or more of these guidelines for nonpublic schools 
at grade 4. The weighted participation rate for the initial sample of nonpublic schools 
at grade 4 was below 85 percent and the weighted school participation rate after 
substitution was below 90 percent (see Appendix A). 

In the analysis of student data and reporting of results, nonresponse weighting 
adjustments have been made at both the school and student level, with the aim of making 
the sample of participating students as representative as possible of the entire eligible 
fourth- and eighth-grade population. For details of the nonresponse weighting 
adjustment procedures, see the Technical Report of the NAEP 1996 State Assessment 
Program in Mathematics, 

Reporting NAEP Mathematics Results 

The NAEP 1996 state assessment program in mathematics provides a wealth of 
information on the mathematical abilities and skills of the fourth- and eighth-grade 
students in participating jurisdictions. To maximize usefulness to policy makers, 
educators, parents, and other interested parties, the NAEP results are presented both as 
average scale scores on the NAEP mathematics scale and in terms of the percentage of 
students attaining NAEP mathematics achievement levels. Thus, NAEP results not only 
provide information about what students know and can do, but also indicate whether 
their achievement meets expectations of what students should know and should be able 
to do. Furthermore, the descriptions of skills and abilities expected of students at each 
achievement level help make the reporting of assessment results more meaningful. 
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The Mathematics Scale 

Students’ responses to the NAEP 1996 mathematics assessment were analyzed to 
determine the percentage of students responding correctly to each multiple-choice 
question and the percentage of students responding in each of several score categories 
for constructed-response questions. Item response theory (IRT) methods were used to 
produce across-grade scales that summarized results for each of the five mathematics 
content strands discussed earlier. Each of the content-strand scales, which range from 
0 to 500, was linked to its corresponding scale from 1990 and 1992 through IRT 
equating. 

An overall composite scale was developed by weighting the separate 
content-strand scales based on the relative importance to each content strand in the 
NAEP mathematics framework. The resulting scale, which was also linked to the 1990 
and 1992 mathematics composite scales, is the reporting metric used in Parts One and 
Three to present results. (Details of the scaling procedures are presented in 
Appendix C of this report, in the NAEP 1996 Technical Report, and in the Technical 
Report of the NAEP 1996 State Assessment Program in Mathematics.) 

Mathematics Achievement Levels 

Results for the NAEP 1996 assessment in mathematics are also reported using the 
mathematics achievement levels that were authorized by the NAEP legislation and 
adopted by the National Assessment Governing Board. The achievement levels are 
based on collective judgments about what students should know and be able to do 
relative to the body of content reflected in the NAEP mathematics assessment. Three 
levels were defined for each grade — Basic, Proficient, and Advanced. The levels were 
defined by a broadly representative panel of teachers, education specialists, and members 
of the general public. 

For reporting purposes, the achievement levels for each grade are placed on the 
NAEP mathematics scale. Figure 1 presents the policy definitions of the achievement 
levels, while Chapter 3 contains specific descriptions for the levels at each grade. 



Figure 1. Policy Definitions of NAEP Achievement Levels 



Basic This level denotes partial mastery of 



prerequisite knowledge and skills that are 
fundamental for proficient work at each grade. 



Proficient This level represents solid academic performance 



for each grade assessed. Students reaching 
this level have demonstrated competency over 
challenging subject matter, including subject- 
matter knowledge, application of such knowledge 
to real-world situations, and analytical skills 
appropriate to the subject matter. 



Advanced This level signifies superior performance. 
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It should be noted that setting achievement levels is a relatively new process for 
NAEP, and it is still in transition. Some evaluations have concluded that the percentage 
of students at certain levels may be underestimated.® On the other hand, critiques of 
those evaluations have asserted that the weight of the empirical evidence does not 
support such conclusions.'® A further review is currently being conducted by the 
National Academy of Sciences. 

The student achievement levels in this report have been developed carefully and 
responsibly, and the procedures used have been refined and revised as new technologies 
have become available. Upon review of the available information, the Commissioner 
of Education Statistics has judged that the achievement levels are in a developmental 
status. However, the Commissioner and the Governing Board also believe that the 
achievement levels are useful and valuable for reporting on the educational achievement 
of students in the United States. Part Two presents results reported in terms of the 
mathematics achievement levels. 

Interpreting NAEP Results 

This report describes mathematics performance for fourth and eighth graders and 
compares the results for various groups of students within these populations — for 
example, those who have certain demographic characteristics or who responded to a 
specific background question in a particular way. The report examines the results for 
individual demographic groups and for individual background questions. It does not 
include an analysis of the relationships among combinations of these subpopulations or 
background questions. 

Because the percentages of students in these subpopulations and their average 
mathematics scale scores are based on samples — rather than on the entire population 
of fourth and eighth graders in a jurisdiction — the numbers reported are necessarily 
estimates. As such, they are subject to a measure of uncertainty, reflected in the 
standard error of the estimate. When the percentages or average scale scores of certain 
groups are compared, it is essential to take the stendard error into account, rather than 
to rely solely on observed similarities or differences. Therefore, the comparisons 
discussed in this report are based on statistical tests that consider both the magnitude 
of the difference between the means or percentages and the standard errors of those 
statistics. 



® General Accounting Office. Educational Achievement Standards: NAGB’s Approach Yields Misleading 
Interpretations. (Washington, DC: General Accounting Office, 1993); Nation^ Academy of Education. Setting 
Petformance Standards for Student Achievement. A Report of the National Academy of Education Panel on the 
Evaluation of the NAEP Trial State Assessment: An Evaluation of the 1992 Achievement Levels. (Stanford, CA: 
National Academy of Education, 1993). 

Cizek, G. Reactions to the National Academy of Education report. (Washington, DC: National Assessment Governing 
Board, 1993); Kane, M. Comments on the NAE Evaluation of the NAGB Achievement Levels. (Washington, DC: National 
Assessment Governing Board, 1993); NAEP Reading Revisited: An Evaluation of the 1992 Achievement Levels 
Descriptions. (American College Testing, Washington, DC: National Assessment Governing Board, 1993); Technical 
Report on Setting Achievement Levels on the 1992 National Assessment of Educatioruil Progress in MathematicSy 
Reading, and Writing. (American College Testing, Washington, DC: National Assessment Governing Board, 1993). 
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The statistical tests determine whether the evidence — based on the data from the 
groups in the sample — is strong enough to conclude that the averages or percentages 
are really different for those groups in the population. If the evidence is strong (i.e., the 
difference is statistically significant), the report describes the group averages or 
percentages as being different (e.g., one group performed higher than or lower than 
another group) — regardless of whether the sample averages or sample percentages 
appear to be about the same or not. If the evidence is not sufficiently strong (i.e., the 
difference is not statistically significant), the averages or percentages are described as 
being not significantly different — again, regardless of whether the sample averages or 
sample percentages appear to be about the same or widely discrepant. The reader is 
cautioned to rely on the results of the statistical tests — rather than on the apparent 
magnitude of the difference between sample averages or percentages — to determine 
whether those sample differences are likely to represent actual differences between the 
groups in the population. The statistical tests are discussed in greater detail in 
Appendix A. 

In addition, some of the percentages reported in the text of the report are given 
quantitative descriptions (e.g., relatively few, about half, almost all, etc.). The 
descriptive phrases used and the rules used to select them are also described in 
Appendix A. 

How Is This Report Organized? 

The NAEP 1996 Mathematics State Report for Colorado is a computer-generated 
report that describes the mathematics performance of fourth- and eighth-grade students 
in Colorado, the West region, and the nation. A separate report describes additional 
fourth- and eighth-grade mathematics assessment results for the nation and the states, 
as well as the national results for grade 12.“ The State Report consists of five sections: 

• An Introduction provides background information about what was 
assessed, who was sampled, and how the results are reported. 

• Part One shows the distribution of mathematics scale score results for 
fourth- and eighth-grade students in Colorado, the West region, and the 
nation. 

• Part Two presents mathematics achievement level results for fourth- and 
eighth-grade students in Colorado, the West region, and the nation. 



Reese, C.M., ICE. Miller, J. Mazzeo, and J.A. Dossey. NAEP 1996 Mathematics Report Card. (Washington, DC: 
National Center for Education Statistics, 1997). 
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• Part Three relates fourth- and eighth-grade public school students’ 
mathematics scale scores to contextual information about school 
characteristics, instruction, and home support for mathematics in 
Colorado, the West region, and the nation. 

• Several Appendices are presented to support the results discussed in the 
report: 



Appendix A Reporting NAEP 1996 Mathematics 
Results for Colorado 

Appendix B NAEP 1996 Mathematics Assessment 
Appendix C Technical Appendix 
Appendix D Setting the Achievement Levels 
Appendix E Teacher Preparation 
Appendix F Discussion of the Grade 8 

Asian/Pacific Islander Sample 
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PART ONE 



The Mathematics Scale Score Results for 
Fourth- and Eighth-Grade Students 

T 

X he following chapters describe the average mathematics scale scores of fourth- 
and eighth-grade students in Colorado. As described in the Introduction, the NAEP 
mathematics scale is a composite of the five content strands that comprise the assessment 
and ranges from 0 to 500. The performance of both fourth- and eighth-grade students 
is reported on this one scale. 

This part of the report contains two chapters. Chapter 1 compares the overall 
mathematics performance of public school students in Colorado to the nation. (Results 
for the West region are also presented.) Chapter 2 summarizes mathematics performance 
for subgroups of public school students defined by gender, race/ethnicity, parental 
education, location of the school, participation in Title I programs and services, and 
eligibility for the free/reduced-price lunch component of the National School Lunch 
Program. The second chapter also provides the combined results for public and 
nonpublic school students, as well as the results for only nonpublic school students. 
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CHAPTER 1 



Students’ Mathematics Scale Score Results 

The delivery of education to the millions of school-age students in our country is 
primarily a function of the states. Therefore, monitoring the performance of students in 
subjects such as mathematics is a key concern of those policy makers directing 
educational reform at the state level. Monitoring the mathematics performance of 
students is also a concern at the national level. 

The need to assess the current level of mathematical ability as a mechanism for 
informing education reform efforts is highlighted by the current National Assessment 
of Educational Progress (NAEP) in mathematics (as well as the two previous NAEP 
assessments in mathematics in 1990 and 1992) and the Third International Mathematics 
and Science Study (TIMSS) conducted in 1994 and 1995 with support from the U.S. 
Department of Education.'^ 

The mathematics community has taken a lead in communicating the importance 
of mathematics in today’s society. With the release of the National Council of Teachers 
of Mathematics (NCTM) Curriculum and Evaluation Standards for School Mathematics 
in 1989, mathematics educators have accepted the challenges set forth by the national 
and state policy makers.'^ Based on drafts of the NCTM Standards, NAEP developed 
the 1990 and 1992 mathematics assessments.'"' The framework and specifications for 
the NAEP 1996 mathematics assessment was refined to better reflect the NCTM 
Standards}' Results from the 1996 assessment can be compared to those from the 1990 
and 1992 assessments, regardless of the refinement of the framework. 



12 

The Third International Mathematics and Science Study was conducted in 1994 in the southern hemisphere and in 1995 
in the northern hemisphere. 

National Council of Teachers of Mathematics. Curriculum and Evaluation Standards for School Mathematics, (Reston, 
VA: NCTM, 1989). 

14 

National Assessment of Educational Progress (NAEP). Mathematics Objectives: 1990 Assessment. (Princeton, NJ: 
Educational Testing Service, 1988). 

National Assessment Governing Board. Mathematics Framework for the 1996 National Assessment of Educational 
Progress, (Washington, DC: National Assessment Governing Board, 1994). 
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The NAEP 1996 state mathematics assessment at grades 4 and 8 continues the 
state-level NAEP component begun in 1990 with the NAEP Trial State Assessment 
(TSA) in mathematics at grade 8, which was followed by the 1992 TSA in mathematics 
at grades 4 and 8/^ The current assessment is also the largest with 48 participating 
jurisdictions/^ The following results from the NAEP 1996 state mathematics 
assessment represent a current picture of the mathematics performance of fourth- and 
eighth-grade students in Colorado and the nation. 

Table 1.1 A shows the distribution of mathematics scale scores for fourth-grade 
students attending public schools in Colorado, the West region, and the nation. Results 
are presented for the 1992 and 1996 assessments and comparisons between the two years 
are indicated.^® The 1992 and 1996 mathematics assessments examined the performance 
of two independent samples of fourth-grade, students (i.e., cross-sectional performemce). 
NAEP does not measure the growth of a group of students (i.e., longitudinal 
performance), but rather collects data for the same grade levels at different points in 
time. Table I.IB presents similar results for eighth-grade students. 



Based on positive evaluations of the 1990, 1992, and 1994 TSAs, the ‘Trial” designation has been removed from the 
1996 state-level NAEP assessment. 




Jurisdictions refers to states, territories, the District of Columbia, and Department of Defense Education Activities 
schools. 

Mathematics was not assessed at grade 4 in 1990. 
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1996, Public School Students, Grade 4 
The average mathematics scale score in Colorado was 226. This average 
was higher than that for the nation (222).*^ 

1992 vs. 1996, Public School Students, Grade 4 
From 1992 to 1996, there was an increase in the average scale score of 
students both in Colorado and across the nation. The observed increase 
for Colorado was not significantly different from the increase for the 
nation. 
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TABLE 1.1 A -GRADE 4 


Distribution of Mathematics Scale Scores for Public School 
Students 


State Assessment 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



1992 


























Colorado 


221 I 


[1.0) 


181 I 


[ 1.8) 


201 1 


[ 1.0) 


222 1 


(0.9) 


242 1 


(1*2) 


259 1 


(0.8) 


West 


218 I 


(1.5) 


175 ( 


(2.7) 


197 1 


[2.1) 


221 I 


(1.9) 


240 1 


(2.3) 


GO 

in 

CM 


(2.5) 


Nation 


219 ( 


(0.8) 


176 ( 


[ 1*1) 


197 1 


[0.9) 


220 I 


[ 1.0) 


241 I 


(1*1) 


259 ( 


(0.9) 


1996 


























Colorado 


226 1 


[ 1.0)> 


187 ( 


(2.1) 


o 

CM 


[1.2)> 


CM 

CM 


[1.5)> 


CM 


(1*3)> 


263 ( 


[ 1.3) 


West 


219 ( 


(2.1) 


177 1 


(4.0) 


197 ( 


[ 2.0) 


220 I 


(2.9) 


240 1 


(2.6) 


259 ( 


(2.1) 


Nation 


CM 


[1.0)> 


180 { 


: 1.5) 


201 ( 


[1.3) 


224 I 


[ 1*3) 


244 1 


[ 1*0) 


261 1 


(1*0) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Differences reported as significant are statistically different at the 95 percent confidence level. 
95 percent confidence there is a real difference in the average mathematics scale score between 
of interest. 



This means that with 
the two populations 
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Table I.IB shows the distribution of mathematics scale scores for eighth-grade 
students attending public schools in Colorado, the West region, and the nation. Results 
are presented for the 1990, 1992, and 1996 assessments and comparisons among the 
three years are indicated. 

1996, Public School Students, Grade 8 
The average mathematics scale score in Colorado was 276. This average 
was higher than that for the nation (271). 

1992 vs. 1996, Public School Students, Grade 8 
From 1992 to 1996, there was somewhat of an increase in the average 
scale score of students both in Colorado and across the nation. The 
observed increase for Colorado was not significantly different from the 
increase for the nation. 

1990 vs. 1996, Public School Students, Grade 8 
The average scale score in Colorado in 1996 (276) was higher than that 
in 1990 (267). 
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TABLE 1.1B-GRADE8 



Distribution of Mathematics Scale Scores for Public School 
Students 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



1990 














Colorado 


267 ( 0.9) 


224 ( 1.5)^ 


246 ( 1.1) 


266 ( 1.2) 


290 ( 1.0) 


309 ( 1.0) 


west 


261 ( 2.6) 


211 ( 3.0) 


235 ( 3.2) 


262 ( 1.6) 


266 ( 2.6) 


309(4.1) 


Nation 


262 ( 1.4) 


214 ( 1.6) 


237 ( 1 .7) 


263 ( 1.4) 


266 ( 1.7) 


307 ( 1.9) 


1992 














Colorado 


272 ( 1.0)»» 


229 ( 1.6) 


251 ( 1.1)» 


274 ( 1.2)» 


295 ( 1.1)» 


313 ( 1.1)« 


west 


266(2.1)» 


219(2.6) 


243 ( 3.1) 


269 ( 2.7) 


294 ( 1 .9) 


314 ( 3.5) 


Nation 


267 ( 1.0)» 


219 ( 1.5) 


242 ( 1.4) 


266 ( 1.2)» 


293 ( 1 .5) 


314 ( 1.4)» 


1996 














Colorado 


276 { 1.1 )»> 


232 ( 2.9) 


254 ( 1.3)» 


277 ( 1.3)» 


299 ( 1 .4)» 


317 ( 1.3)« 


west 


* 266 { 2.4)»* 


219 ( 4.6) 


244 ( 3.0) 


269 ( 1.7)» 


294 ( 3.4) 


314 ( 3.0) 


Nation 


271 { 1.2)»> 


222 ( 2.0)» 


247 ( 1 .2)»> 


272 ( 1.1 )»> 


296 ( 1 .4)» 


316(2.0)» 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation » («) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1990 at about the 95 percent confidence level. If the notation > (<) 
appears, it sigirifles that the value for public school students was significantly higher (lower) than the value for 1992 at 
about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990, 1992, 
and 1996 Mathematics Assessments. 
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Comparisons Between Colorado and Other Participating 
Jurisdictions 

The maps on the following pages provide a method for making appropriate 
comparisons of the average mathematics scale scores for public school students in 
Colorado with those of other jurisdictions participating in the NAEP 1996 mathematics 
assessment. The different shadings of the states on the map show whether or not the 
average scale scores of public school students in the other jurisdictions were statistically 
different from that of public school students in Colorado (“Target State”). States with 
horizontal lines have a significantly lower average mathematics scale score than 
Colorado and states in gray have a significantly higher average scale score. The 
unshaded states have average scale scores that did not differ significantly from the 
average for Colorado. Several states, those with large crosshatching, did not meet 
minimum participation rate guidelines established by NCES for the NAEP assessments. 
A description of the statistical procedures used to produce the data represented in these 
maps is contained in Appendix A. 
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The NAEP 1996 State Assessment 

Comparisons of Overall Mathematics Scale Scores at Grade 4 

Colorado Public School Students 




The NAEP 1996 State Assessment 

Comparisons of Overall Mathematics Scale Scores at Grade 8 

Colorado Public School Students 
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Performance on the NAEP Mathematics Content Strands 

The framework and specifications that guided the development of the NAEP 
mathematics assessments are anchored in broad strands of mathematical content similar 
to the content standards in the NCTM Standards, These content strands are 

• Number Sense, Properties, and Operations 

• Measurement 

• Geometry and Spatial Sense 

• Data Analysis, Statistics, and Probability 

• Algebra and Functions^ 

Tables 1.2A Md 1.2B show the distribution of content strand scale scores for 
Colorado, the West region, and the nation. Appendix B describes the five content 
strands, and Appendix C contains a more extensive discussion of the scaling procedures 
used to develop the five content-strand scales as well as the composite NAEP 
mathematics scale. 



1996, Public School Students, Grade 4 
Students in Colorado performed higher than students nationwide in 
measurement and geometry and spatial sense. The performance of 
students in Colorado did not differ significantly from that of students 
nationwide in number sense, properties, and operations; data analysis, 
statistics, and probability; and algebra and functions. 

1992 vs. 1996, Public School Students, Grade 4 
The performance of students in Colorado improved between 1992 and 
1996 in algebra and functions. The performance of students in Colorado 
did not change significantly between 1992 and 1996 in number sense, 
properties, and operations; measurement; geometry and spatial sense; 
and data analysis, statistics, and probability. 




20 



At the fourth-grade level, the Algebra and Functions strand was treated in 
the study of patterns. 



informal and exploratory ways, often through 
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TABLE 1.2A — GRADE 4 


Distribution of Mathematics Scale Scores for Public School 
Students by Content Area 


State Assessment 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



Number Sense, Properties, 
end Operetlons 
1992 
Colorado 


217 


(1.1) 


174 1 


(2.3) 


195 1 


(1.4) 


218 1 


(1.0) 


239 1 


(1.1) 


258 1 


(1.3) 


West 


215 


1.7) 


170 1 


(1.9) 


192 1 


(1.7) 


217 I 


(2.4) 


239 1 


(2.4) 


258 1 


(3.0) 


Nation 


216 


0.9) 


170 1 


(1.2) 


193 1 


(1.2) 


217 1 


(1.1) 


240 1 


(0.9) 


259 1 


(1.1) 


1996 




















Colorado 


221 


1.4) 


178 1 


(1.8) 


199 1 


( 1.5) 


223 1 


(1.4) 


245 1 


(1.1)> 


264 1 


(2.1) 


West 


215 


1.9) 


170 1 


(2.9) 


193 1 


(2.6) 


216 1 


(1.9) 


238 1 


(2.7) 


259 1 


(2.1) 


Nation 


219 


1.1) 


174 1 


(1.1) 


197 1 


(0.8) 


221 1 


(1.1) 


243 1 


(1.3) 


262 1 


[ 1.6) 


Meesurement 

1992 






















Colorado 


226 


1.1) 


184 1 


(1.0) 


205 1 


(1.6) 


228 1 


(1.6) 


249 1 


(1.6) 


266 1 


(2.7) 


West 


222 


1.6) 


176 1 


(3.2) 


199 1 


(2.1) 


224 1 


(2.0) 


246 1 


(2.4) 


264 1 


(2.8) 


Nation 


223 I 


(0.9) 


178 ( 


(1.2) 


201 1 


(1.3) 


225 1 


(0.9) 


247 ( 


(1.8) 


265 1 


(1.0) 


1996 




















Colorado 


230 I 


[1.3) 


187 ( 


(2.0) 


209 1 


(1.7) 


231 1 


[ 1.5) 


252 1 


(1.3) 


270 ( 


(1.3) 


West 


220 I 


[2.6) 


174 ( 


(4.3) 


197 ( 


(2.3) 


221 1 


(3.3) 


244 1 


(3.2) 


264 1 


(3.1) 


Nation 


224 I 


[1.2) 


178 ( 


(2.3) 


201 1 


(1.8) 


226 1 


(1.5) 


248 1 


(1.3) 


266 1 


[1.0) 


Geometry end Spetiei Sense 
1992 




















Colorado 


227 ( 


[0.9) 


192 < 


[ 1.8) 


209 1 


(1.3) 


228 1 


(1.0) 


246 1 


(0.8) 


262 4 


[1.2) 


West 


222 { 


[1.3) 


182 1 


(0.9) 


202 1 


(1.6) 


224 1 


(1.8) 


244 1 


(1.9) 


260 4 


: 1.8) 


Nation 


221 I 


[0.7) 


181 1 


(1.6) 


201 1 


(0.8) 


222 1 


(1.1) 


243 1 


(1.2) 


260 4 


[1.1) 


1996 




















Colorado 


230 { 


[1.3) 


191 ( 


(1.8) 


211 I 


[1.5) 


231 1 


(1.4) 


250 1 


(1.3) 


267 4 


[1.7) 


West 


222 { 


[2.1) 


183 1 


(2.5) 


202 4 


[2.9) 


223 1 


(2.0) 


243 1 


(2.9) 


260 4 


[3.0) 


Nation 


224 { 


[0.9) 


184 ( 


(1.1) 


205 I 


[0.9) 


226 1 


(1.4) 


245 1 


(0.8) 


261 4 


[1.2) 


Dete Aneiyeis, Stetietice, 
end Probebiiity 
1992 






















Colorado 


221 { 


[1.2) 


179 ( 


(2.4) 


200 { 


[1.9) 


223 1 


(1.7) 


244 4 


[1.1) 


261 4 


: 1.8) 


West 


218 { 


[1.9) 


174 ( 


[2.9) 


196 { 


[2.6) 


221 4 


[2.6) 


242 4 


[2.1) 


258 4 


[3.9) 


Nation 


219 { 


:i.o) 


175 ( 


[1.7) 


198 { 


[1.2) 


221 4 


[1.4) 


243 1 


[1.6) 


260 4 


[1.6) 


1996 






















Colorado 


225 { 


[1.5) 


187 ( 


[1.9) 


206 4 


[1.7) 


227 4 


;i.2) 


246 4 


[1.8) 


262 4 


[2.0) 


West 


219 { 


[2.7) 


177 ( 


[3.8) 


197 4 


[3.0) 


221 1 


[2.9) 


242 4 


[3.4) 


259 4 


[2.8) 


Nation 


223 { 


[1.4) 


180 1 


[1.8) 


202 4 


[1.6) 


225 4 


[1.4) 


246 4 


[1.5) 


263 4 


[1.1) 


Aigebra end Functione 
1992 






















Colorado 


219 { 


[1.3) 


175 { 


[1.6) 


197 4 


[1.6) 


220 4 


[1.3) 


242 4 


[1.4) 


261 4 


[1.3) 


West 


217 { 


[1.9) 


173 { 


[2.4) 


195 4 


[1.2) 


219 4 


[3.0) 


240 4 


[3.2) 


258 4 


[3.3) 


Nation 


218 { 


[0.9) 


173 I 


[1.3) 


195 4 


[0.9) 


219 4 


[1.4) 


241 4 


[1.5) 


259 4 


[1.8) 


1996 






















Colorado 


229 { 


:i.4)> 


192 1 


[2.1)> 


211 4 


: i.5)> 


'231 4 


: 2.0)> 


249 4 


[1.8) 


264 4 


[1.6) 


West 


223 { 


[2.5) 


180 1 


[3.4) 


202 4 


[2.7) 


224 4 


[2.9) 


244 4 


[3.3) 


261 4 


[2.6) 


Nation 


226 { 


:i-2)> 


185 1 


[1.8)> 


206 4 


[1.3)> 


227 4 


;i.7)> 


247 4 


[1.5) 


264 4 


[ 1.5) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), ,1992 and 
1996 Mathematics Assessments. 
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1996, Public School Students, Grade 8 
Colorado students performed higher than students across the nation in 
measurement and geometry and spatial sense. The performance of 
students in Colorado did not differ significantly from that of students 
across the nation in number sense, properties, and operations; data 
analysis, statistics, and probability; and algebra and functions. 

1992 vs. 1996, PubUc School Students, Grade 8 
There was an improvement in the performance of students in Colorado 
from 1992 to 1996 in geometry and spatial sense. There was no 
significant change in the performance of students in Colorado from 1992 
to 1996 in number sense, properties, and operations; measurement; data 
analysis, statistics, and probability; and algebra and functions. 

1990 vs. 1996, PubUc School Students, Grade 8 
There was an improvement in the performance of students in Colorado 
from 1990 to 1996 in all five of the content strands. 



THE NATION': 
REPORT 
CARD 




State Assessment 



TABLE 1.2B - GRADE 8 

Distribution of Mathematics Scale Scores for Public School 
Students by Content Area 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



Number Sense, Properties, 














and Operations 
1990 














Colorado 


269 ( 1.0) 


226 ( 1.4) 


246 ( 1.2) 


270 ( 1 .5) 


292 ( 1.4) 


311 ( 1.7) 


West 


263 ( 2.5) 


217 ( 4.6) 


239 ( 1 .9) 


264 ( 2.3) 


266 ( 3.0) 


310 ( 4.9) 


Nation 


266 (1.3) 


220 ( 2.4) 


242 ( 2.3) 


267 ( 1.2) 


291 ( 1.4) 


309 ( 1.3) 


1992 














Colorado 


274 ( 1.1)« 


230 ( 1.6) 


253 ( 1 .4) 


276 ( 1.2) 


297 ( 1.3) 


315 ( 1.6) 


West 


271 ( 1 .6) 


224 ( 2.5) 


247 ( 2.3) 


272 ( 2.2) 


296 ( 1.4) 


317(2.7) 


Nation 


271 ( 0.9)« 


225 ( 0.6) 


247 ( 1 .0) 


272 ( 1.4) 


296 ( 1.0) 


315 ( 1.2)» 


1996 

Colorado 


276 ( 1.3)« 


231 ( 2.9) 


254 ( 1.7) 


276 ( 1 .4)» 


300 ( 2.0)» 


316 ( 1.6) 


West 


270 ( 2.3) 


223 ( 4.6) 


247 ( 2.6) 


271 ( 3.0) 


296 ( 1.9) 


316(2.7) 


Nation 


272 ( 1.2)« 


225 ( 1.5) 


249 ( 1.6) 


274 ( 1 .6)» 


296 ( 1.2)» 


317 ( 1.4)» 



(continued on next page) 





THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



41 



Colorado 



THE 

REPORT 

CARO 


UJION 

rc3E| 


’S 

1 


TABLE 1.2B — GRADE 8 (continued) 


Distribution of Mathematics Scale Scores for Public School 
Students by Content Area 


state Assessment 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



Measurement 



1990 



Colorado 


265 


1.2) 


213 { 


[2.1) 


239 1 


(1.4) 


265 1 


[ 1.4) 


292 1 


[ 1.8) 


316 { 


[3.0) 


West 


257 


3.2) 


200 1 


[4.2) 


228 1 


(2.3) 


258 1 


(4.7) . 


287 ( 


(3.5) 


313 { 


[3.8) 


Nation 


258 


1.6) 


202 1 


: 1.9). 


230 1 


[ 2.7) 


259 1 


[ 2:2) . 


288 1 


(2.2) 


312 { 


[2.3) 


1992 


























Colorado 


274 


1.5)» 


221 1 


[2.5) 


247 ( 


[1.9)« 


274 ( 


[ 1.6)« 


302 1 


[2.1)» 


325 { 


: 1.3) 


West 


267 


2.8) 


210 1 


[4.3) 


236 1 


(2.0) 


268 1 


(2.2) 


298 1 


(4.1) 


325 { 


[3.4) 


Nation 


265 


1.3)» 


207 1 


: 1.5) 


234 ( 


(1.6) 


266 1 


(1.7) 


296 1 


(1.7) 


323 { 


[2.8) 


1996 


























Colorado 


276 


2.1)» 


217 1 


[3.6) 


247 ( 


(3.3) 


279 ( 


[ 2.3)« 


308 1 


[ 1.7)« 


332 { 


[2.1)« 


West 


265 


3.2) 


203 1 


[5.2) 


235 1 


(4.6) 


267 ( 


(5.1) 


298 1 


(3.0) 


324 { 


[3.7) 


Nation 


268 


1.6)« 


206 1 


[2.2) 


238 1 


(1.9) 


270 ( 


[1.8)« 


301 1 


[ 2.7)« 


328 { 


: 2.3)» 


Geometry and Spatial Sense 
1990 
























Colorado 


266 


1.1) 


226 1 


: 1.8) . 


245 1 


(1.4) 


266 1 


(1.2) 


287 ( 


(0.9) 


305 { 


[ 1.2) 


West 


260 


2.6) 


213 1 


: 2.3) 


236 1 


(2.6) 


261 1 


(2.1) 


284 ( 


(3.8) 


305 { 


[4.4) 


Nation 

1992 


259 1 


[ 1.4) 


213 1 


[2.0) 


236 1 


(1.7) 


260 1 


(1.2) 


284 ( 


[ 1.4) 


303 { 


[ 1.9) 


Colorado 


269 1 


(1.1) 


229 1 


: 1.9) 


249 1 


(1.5) 


270 ( 


(1.1) 


290 1 


(1.2) 


307 ( 


(2.1) 


West 


263 1 


[2.1) 


218 1 


(3.6) 


240 1 


(3.1) 


264 1 


(2.3) 


287 1 


(2.3) 


307 ( 


(2.0) 


Nation 


262 1 


[ 1.0) 


217 ( 


[ 1.0) 


239 1 


(14). 


263 1 


[ 1.0) 


287 1 


[ 1.1) 


306 1 


(1.3) 


1996 


























Colorado 


275 ( 


[ 1.0)«> 


238 1 


[1.4)«> 


256 1 


[ 0.9)»> 


276 1 


[ 1.3)« 


295 1 


[ 1.2)» ■ 


312 1 


[1.5)« 


West 


267 ( 


[2.5) 


224 1 


(4.0) 


245 1 


(3.8) 


268 1 


(2.4) 


290 1 


[ 1.6) 


309 1 


(2.7) 


Nation 


268 1 


[ 1.3)«> 


225 1 


[ 1.9)»» 


247 1 


[1.6)»> 


270 ( 


[ 1.4)«> 


291 1 


[ 1.2)» 


310 1 


(1.9) 


Data Analysis, Statistics, 


























and Probability 


























1990 


























Colorado 


270 ( 


[ 1.1) 


224 1 


[ 2.3) 


247 1 


[ 1.3) 


272 1 


[ 1.2) 


294 1 


( 1.0) 


313 1 


[ 1.3) 


West 


261 1 


[3.2) 


206 1 


(4.2) 


232 1 


(3.8) 


263 1 


(2.5) 


290 1 


(5.3) 


313 I 


(4.4) 


Nation 


262 1 


[ 1.6) 


207 ( 


(3.1) 


234 1 


(2.0) 


264 1 


[ 1.4) 


292 1 


(1.4) 


313 I 


(1.6) 


1992 
























Colorado 


274 ( 


[ 1.3) 


223 1 


[ 1.7) 


250 1 


[ 1.3) 


276 1 


[ 1.4) 


301 1 


( 1.6)» 


321 1 


(1.7)» 


West 


268 1 


(2.4) 


212 1 


(3.6) 


239 1 


(4.2) 


269 1 


(3.9) 


298 1 


(2.0) 


321 I 


(3.6) 


Nation 


267 I 


(1.1) 


213 1 


[ 1.3) 


238 1 


[ 1.4) 


268 1 


[ 1.6) 


297 I 


( 1.5) 


320 1 


(1.7) 


1996 


























Colorado 


276 I 


( 1.6)« 


222 1 


(2.5) 


249 1 


(2.5) 


279 I 


(1.5)« 


305 


( 1.6)« 


327 I 


( 1.8)» 


West 


266 1 


(3.3) 


206 1 


(5.5) 


238 1 


(4.1) 


270 I 


(3.1) 


298 


(3.9) 


320 1 


(2.6) 


Nation 


270 I 


(1.7)» 


212 I 


(1.8) 


243 1 


(2.1) 


274 I 


(1.8)« 


301 


( 2.4)« 


324 1 


(1.8)« 


Algebra and Functions 
1990 


























Colorado 


266 1 


( 1.0) 


220 1 


( 1.5) 


243 1 


(1.4) 


267 I 


( 1.5) 


290 I 


(1.1) 


310 1 


(1.2) 


West 


259 1 


(2.6) 


210 1 


( 1.8) 


234 1 


(2.4) 


259 1 


(2.2) 


285 


(2.9) 


310 1 


(4.9) 


Nation 


260 1 


( 1.3) 


212 1 


(2.6) 


235 I 


(1.7) 


261 1 


(1.5) 


286 I 


( 1.6) 


308 1 


(2.6) 


1992 


























Colorado 


271 I 


(1.1)« 


227 I 


( 1.6) 


250 1 


( 1.6)« 


273 I 


( 1.5) 


294 


( 1.2) 


313 1 


(1.1) 


West 


266 1 


(2.5) 


218 1 


(2.4) 


241 I 


(2.6) 


267 I 


(3.0) 


291 


(2.3) 


314 1 


(4.5) 


Nation 


267 I 


( 1.1)« 


219 1 


( 1.4) 


241 I 


( 1.2) 


267 I 


(1.1) 


292 


( 1.3) 


314 1 


(2.1) 


1996 
























Colorado 


275 


( 1.3)« 


231 1 


( 1.9)« 


252 1 


( 1.7)« 


275 I 


(1.5)« 


299 


( 1.2)« 


318 


(1.2)« 


West 


270 1 


( 2.2)« 


224 1 


( 2.6)« 


247 I 


(4.1) 


270 1 


( 1.8)« 


294 


(2.2) 


315 


(2.4) 


Nation 


272 


( 1.2)«> 


226 1 


( 1.9)» 


248 1 


( 1.8)«> 


272 I 


( 1.3)« 


297 


( 1.4)« 


318 I 


(2.1) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation » («) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1990 at about the 95 percent confidence level. If the notation > (<) 
appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 at 
about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990, 1992, 
and 1996 Mathematics Assessments. 
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Mathematics Scale Score Results by 
Subpopulations 

The previous chapter provided a global view of the mathematics performance of 
fourth- and eighth-grade students in Colorado and the nation. It is also important to 
examine the average performance of subgroups since past NAEP assessments in 
mathematics, as well as in other academic subjects, have shown substantial differences 
among groups defined by gender, racial/ethnic background, parental education, and other 
demographic characteristics.^^ A key contribution of NAEP to the ongoing 
conversations on education reform is its ability to monitor the performance of subgroups 
of students in academic achievement. 

The NAEP 1996 state assessment in mathematics provides performance 
information for subgroups of fourth and eighth graders in Colorado, the West region, 
and the nation. In addition to the more typical demographic subgroups defined by 
gender, race/ethnicity, parental education, and location of the school, the 1996 
assessment also collected information on student participation in Title I programs and 
services and eligibility for the free/reduced-price lunch component of the National 
School Lunch Program. 

The 1996 state assessment in mathematics also continues a component first 
introduced with the NAEP 1994 state assessment in reading — assessment of a 
representative sample of nonpublic school students. The 1996 state assessment marks 
the first time that NAEP mathematics results for public and nonpublic school students 
can be presented and compared at the state level. The comparison of public and 
nonpublic school students’ performance does not account for confounding factors such 
as student composition, family socioeconomic status, and parental involvement in their 
child’s education. The size of the NAEP nonpublic school sample in most jurisdictions 
does not allow for such in-depth analyses, and a more complete picture of public and 
nonpublic school comparisons may be achieved by supplementing NAEP results with 
data from other sources, such as the School and Staffing Survey (SASS) or National 
Education Longitu dinal Study (NELS).^ 

Campbell, J.R., P.L. Donahue, C.M. Reese, and G.W. Phillips. NAEP 1994 Reading Report Card for the Nation and 
the States. (Washington, DC: National Center for Education Statistics, 1996); Beatty, A.S., C.M. Reese, H.R. Persky, 
and P. Carr. NAEP 1994 U.S. History Report Card. (Washington, DC: National Center for Education Statistics, 1996); 
Persky, H.R., C.M. Reese, C.Y, O'Sullivan, S. Lazer, J. Moore, and S. Shakrani. NAEP 1994 Geography Report Card. 
(Washington, DC: National Center for Education Statistics, 1996); Campbell, J.R., C.M. Reese, C. O’Sullivan, and J.A. 
Dossey. NAEP 1994 Trends in Academic Progress. (Washington, DC: National Center for Education Statistics, 1996). 



22 

National Center for Education Statistics. Schools and Staffing in the United States: A Statistical Profile, 1993-94. 
(Washington, DC: National Center for Education Statistics, 1996); National Education Longitudinal Study. National 
Education Longitudinal Study of 1988: Base Year Student Survey. (Washington, DC: National Center for Education 
Statistics, 1995). 



48 



THE NAEP 1996 STATE ASSESSMENT W MATHEMATICS 



43 



Colorado 



A description of the subgroups and how they are defined is presented in 
Appendix A. The reader is cautioned against making simple or causal inferences related 



to the performance of various subgroups of students or about the effectiveness of public 
and nonpublic schools or Title I programs. Average performance differences between 
two groups of students may, in part, be due to socioeconomic or other factors. For 
example, differences observed among racial/ethnic subgroups are almost certainly 
associated with a broad range of socioeconomic and educational factors not discussed 
in this report and possibly not addressed by the NAEP assessment program. Similarly, 
differences in performance between students participating in Title I programs and those 
who are not does not account for the initial performance level of the students prior to 
placement in Title I programs or differences in course content and emphasis between the 
two groups. 

Gender 

Consistent with research findings, NAEP mathematics results have shown little 
difference in the performance of male and female fourth and eighth graders.” As shown 
in Table 2.1A, the NAEP 1996 state mathematics assessment results for fourth graders 
in Colorado are consistent with those general findings. 

1996, Public School Students, Grade 4 
The average mathematics scale score of males did not differ significantly 
from that of females in both Colorado and the nation. 

1992 vs. 1996, Public School Students, Grade 4 
From 1992 to 1996 in Colorado, the average scale score of both males 
and females increased. 



Frost, L.A., J.S. Hyde, and E. Fennema. “Gender, Mathematics Performance, and Mathematics-Related Attitudes and 
Affect: A Meta-aniytic Synthesis,” in International Journal of Educational Research, 21, pp. 373-385, 1994; Reese, 
C.M., K.E. Miller, J. Mazzeo, and J.A. Dossey. NAEP 1996 Mathematics Report Card. (Washington, DC: National 
Center for Education Statistics, 1997). 
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TABLE 2.1A-GRADE4 


Distribution of Mathematics Scale Scores for Public School 


State Assessment 


Students by Gender 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



Male 




























1992 


Colorado 


222 1 


(1.2) 


181 I 


(3.8) 


202 1 


(1.1) 


224 < 


: 1.7) 


242 1 


[ 1.9) 


261 I 


(2.4) 




West 


218 1 


[ 1.6) 


174 1 


(1.6) 


196 I 


(2.3) 


220 < 


[1.7) 


241 I 


(3.2) 


259 4 


[3.1) 




Nation 


220 I 


(0.9) 


175 1 


(1.3) 


198 I 


(0.8) 


221 \ 


[1.4) 


243 I 


[ 1.4) 


261 4 


[1.6) 


1996 


Colorado 


227 ( 


[ 1.2)> 


188 I 


(2.5) 


207 ( 


[ 1.3)> 


228 < 


[1.1) 


248 I 


(2.2) 


265 4 


: 1.6) 




West 


220 1 


[2.3) 


176 ( 


(6.4) 


198 I 


[ 1.9) 


221 \ 


[2.7) 


242 I 


(2.5) 


262 4 


[2.3) 




Nation 


224 1 


[ 1.2)> 


181 I 


[ 1.8) 


202 I 


(2.5) 


225 \ 


: 1.3) 


246 I 


(0.8) 


264 4 


: 1.6) 


Female 




























1992 


Colorado 


220 I 


[1.2) 


181 I 


(1.7) 


201 I 


(1-1) 


221 < 


[1-5) 


241 I 


[ 1.2) 


257 4 


[1.7) 




West 


218 I 


[ 1.8) 


177 ( 


(3.0) 


198 I 


(2.6) 


221 < 


[3.3) 


239 I 


(2.7) 


257 4 


[2.2) 




Nation 


218 I 


[1.1) 


176 ( 


(1.2) 


197 ( 


(2.2) 


219 I 


[1.1) 


239 I 


(2.2) 


257 4 


[1.1) 


1996 


Colorado 


224 I 


[ 1.4)> 


186 I 


(2.5) 


206 1 


(1.9) 


226 \ 


[1.6) 


245 I 


(1.2) 


260 4 


: 1.8) 




West 


217 ( 


[2.1) 


177 ( 


(5.6) 


197 ( 


(2.4) 


219 4 


[2.8) 


239 I 


(3.0) 


254 4 


[2.8) 




Nation 


221 I 


[1.1) 


180 I 


[ 1.9) 


201 I 


(1.6) 


223 4 


[1.3) 


-242 I 


(0.9) 


259 4 


[1.0) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Table 2. IB presents results for male and female eighth graders for Colorado, the 
West region, and the nation. 

1996, Public School Students, Grade 8 
The average mathematics scale score of males was higher than that of 
females in Colorado; nationwide, however, the performance of males 
did not differ significantly from that of females. 

1992 vs. 1996, Public School Students, Grade 8 
From 1992 to 1996 in Colorado, the average scale score of both males 
and females did not change significantly. 

1990 vs. 1996, Public School Students, Grade 8 
From 1990 to 1996 in Colorado, the average scale score of both males 
and females increased. 
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TABLE 2.1B-GRADE8 


Distribution of Mathematics Scale Scores for Public School 
Students by Gender 


State Assessment 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



Male 




























1990 


Colorado 


269 ( 


:i.o) 


225 ( 


:2.7) 


247 \ 


:i.4) 


270 < 


:i.o) 


292 ( 


: 1.5) 


311 ( 


:i.7) 




West 


262 { 


[3.3) 


212 ( 


:3.5) 


237 \ 


:4.7) 


263 ( 


(3.1) 


287 { 


(3.1) 


310 { 


(5.4) 




Nation 


262 { 


:i.7) 


213 ( 


:2.6) 


237 { 


[2.2) 


263 ( 


:i.3) 


289 { 


(2.1) 


310 { 


(2.0) 


1992 


Colorado 


274 { 


: 1-2)» 


231 { 


[2.3) 


253 { 


: 1-6) 


275 < 


:i.i)« 


297 { 


(1-0)» 


314 { 


(2.1) 




West 


266 1 


[2.7) 


216 { 


[3.6) 


241 1 


(4.5) 


267 I 


|3.8) 


293 \ 


: 1.9) 


314 { 


(2.6) 




Nation 


266 1 


:i.i) 


218 { 


:i.4) 


241 1 


(2.0) 


267 \ 


(1.5) 


293 I 


( 1.0) 


313 { 


( 1.9) 


1996 


Colorado 


278 ( 


[1.4)» 


233 { 


[5.7) 


256 1 


[ 1-8)» 


279 1 


:i.o)« 


302 I 


(1.7)« 


320 1 


( 1.2)** 




West 


267 1 


(2.7) 


214 1 


(4.5) 


241 1 


(4.8) 


269 \ 


[3.1) 


295 I 


(2.8) 


314 ( 


(3.6) 




Nation 


270 1 


[1.5)» 


219 1 


(3.0) 


245 1 


(2.0) 


272 1 


: i.8)» 


298 I 


(1.7)» 


318 1 


(1.5) 


Female 




























1990 


Colorado 


266 1 


(1.4) 


223 1 


(3.2) 


245 1 


(2.2) 


267 1 


:i.i) 


288 I 


(1.7) 


307 ( 


(2.4) 




West 


259 1 


(2.7) 


211 ( 


(5.0) 


233 1 


(3.6) 


261 1 


(2.4) 


284 I 


(4.7) 


307 ( 


(9.1) 




Nation 


261 I 


(1.4) 


215 I 


(3.5) 


237 1 


(2.2) 


263 1 


(1.4) 


286 I 


( 1.4) 


304 I 


(1.6) 


1992 


Colorado 


271 I 


(1.3)» 


227 1 


(3.1) 


249 1 


(1.6) 


273 ( 


( 0.9)» 


294 I 


(1.7) 


312 I 


(1.4) 




West 


269 1 


( 2.2)» 


222 1 


(3.4) 


244 1 


(3.6) 


270 ( 


(2.7) 


293 I 


(2.1) 


315 I 


(2.4) 




Nation 


267 1 


(1.1)« 


220 1 


(2.0) 


242 I 


( 1.4) 


268 1 


(1.3) 


292 


(1.1)« 


314 I 


(1.6)» 


1998 


Colorado 


274 I 


(1.3)« 


231 1 


(2.6) 


252 


(1.9) 


275 I 


(1.6)« 


297 


( 1.5)« 


314 I 


( 1.3) 




West 


270 I 


( 2.5)» 


226 


(3.6) 


248 


(5.3) 


269 1 


(2.0) 


292 


(3.9) 


314 1 


(3.8) 




Nation 


271 


(1.2)« 


225 I 


(1.7) 


248 


( 2.2)« 


272 I 


( 1.7)» 


295 


( 1.5)» 


314 


(1.3)»» 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation » («) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1990 at about the 95 percent confidence level. If the notation > (<) 
appears, it signifies that the value for public school students was significantly higher Oower) than the value for 1992 at 
about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990, 1992, 
and 1996 Mathematics Assessments. 
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Race/Ethnicity 

As part of the background questions administered with the NAEP 1996 
mathematics assessment, students were asked to identify the racial/ethnic subgroup that 
best describes them. The five mutually exclusive categories were White, Black, 
Hisp 2 inic, Asian or Pacific Islander, and American Indian or Alaskan Native. 

The national and regional results for eighth-grade Asian/Pacific Islander students 
are not included in the main body of this report. A thorough investigation into the 
quality and credibility of these results, which included an independent review by the 
National Institute of Statistical Sciences, was initiated by NCES. Collateral results from 
the grade 8 state assessment program in mathematics suggested that the 1996 national 
results may substantially underestimate actual achievement of the Asian/Pacific Islander 
group. Because of its potential to misinform, NCES decided to omit the national 
grade 8 Asian/Pacific Islander results from the body of the report and to include them 
in an appendix. Appendix F includes 1996 results for this group along with a description 
of the findings that led to this decision. 

Research over past decades has shown that racial/ethnic differences exist in 
mathematics performance, and findings from previous NAEP assessments are consistent 
with this body of research.^ However, when interpreting differences in subgroup 
performance, confounding factors related to socioeconomic status, home environment, 
and educational opportunities available to students need to be considered.^ The 
distribution of fourth-grade mathematics scale scores for Colorado, the West region, and 
the nation are shown in Table 2.2A for White, Black, Hispanic, Asian/Pacific Islander, 
and American Indian students. 

1996y Public School Students, Grade 4 
White students in Colorado demonstrated an average mathematics scale 
score that was higher than that of Black, Hispanic, 2 ind American Indian 
students but was not significantly different from that of Asian/Pacific 
Islander students. 

1992 vs. 1996, Public School Students, Grade 4 
From 1992 to 1996, there was an increase in the average scale score of 
White students in Colorado. From 1992 to 1996, there was no 
significant change in the average scale score of Black, Hispanic, 
Asian/Pacific Islander, or American Indian students in Colorado. 



Campbell, J.R., C.M. Reese, C. O’Sullivan, and J.A. Dossey. NAEP 1994 Trends in Academic Progress. (Washington, 
DC: National Center for Education Statistics, 1996); Reese, C.M., K.E. Miller, J. Mazzeo, and J.A. Dossey. NAEP 1996 
Mathematics Report Card. (Washington, DC: National Center for Education Statistics, 1997). 

McKenzie, F.D. “Educational Strategies for uie’’ 1990s,” in The State of Black America 1991. (New York, NY: National 
Urban League, Inc., 1991). 
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TABLE 2.2A - GRADE 4 


Distribution of Mathematics Scale Scores for Public School 


State Assessment 


Students by Race/Ethnicity 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



White 


























1992 


Colorado 


226 


1.0) 


191 1 


[1.7) 


209 1 


(1.3) 


229 { 


[1.1) 


246 { 


[1.0) 


264 ( 1.2) 




West 


226 


1.8) 


166 { 


[2.2) 


207 ( 


(3.1) 


226 { 


[1.7) 


246 < 


[2.7) 


261 ( 2.3) 




Nation 


227 


1.0) 


169 { 


[1.6) 


206 1 


(1.2) 


229 { 


[0.9) 


247 { 


[1.2) 


263 ( 1.2) 


1996 


Colorado 


233 


1.0)> 


196 1 


(2.5) 


215 1 


(1.7) 


234 1 


(1.1) 


252 { 


: 0.8)> 


266 ( 1.3) 




West 


227 


2.2) 


169 1 


(4.1) 


206 1 


(3.8) 


226 1 


(1.7) 


246 { 


[2.1) 


264 ( 1 .3) 




Nation 


231 


1.1 )> 


195 1 


(1.2) 


213 1 


(2.0) 


232 1 


(1.0) 


250 { 


[0.9) 


266 ( 1.0) 


Black 


























1992 


Colorado 


200 


2.8) 


163 1 


(5.2) 


161 1 


(7.4) 


202 1 


(5.4) 


219 1 


[2.7) 


235 (10.1) 




West 


169 1 


(2.7) 


152 1 


(4.0) 


171 ( 


(3.4) 


169 1 


(3.4) 


209 { 


[4.8) 


226 ( 9.6) 




Nation 


192 1 


(1.4) 


155 ( 


(2.6) 


173 ( 


(2.5) 


193 1 


(1.7) 


211 { 


[1.7) 


226 ( 2.7) 


1998 


Colorado 


196 ( 


[ 3.9)1 


153 ( 


[ 9.6)1 


178 1 


[ 6.7)! 


196 1 


[ 3.8)1 


215 1 


[ 5.5)1 


230 ( 9.0)1 




West 


200 1 


[5.3) 


165 ( 


(3.7) 


161 1 


(2.4) 


196 1 


(3.0) 


219 1 


(9.1) 


236 (12.3) 


Nation 

Hispanic 


2001 


[2.4) 


1631 


(2.3) 


181 1 


(1.9) 


200 1 


(2.8) 


220 1 


(3.2) 


236 ( 3.6) 


1992 


Colorado 


206 1 


(1.4) 


166 1 


(3.4) 


187 1 


(1.8) 


206 1 


(2.6) 


227 1 


(2.2) 


243 ( 2.4) 




West 


201 1 


(2.0) 


163 1 


(4.8) 


161 1 


(2.5) 


201 1 


[ 1.6) 


222 1 


(2.8) 


240 ( 2.2) 




Nation 


201 1 


(1.5) 


163 1 


(3.1) 


181 1 


(1.8) 


201 1 


(1.4) 


221 1 


(1.7) 


239 ( 2.6) 


1996 


Colorado 


210 1 


(1.5) 


172 I 


(2.5) 


191 1 


(3.2) 


211 1 


(1.4) 


230 1 


(1.8) 


246 ( 3.0) 




West 


203 1 


(3.4) 


161 I 


(7.7) 


162 1 


(5.7) 


204 1 


(2.9) 


226 1 


(2.2) 


242 ( 2.4) 


Nation 

Asian/Pacific Islander 


205 1 


(2.2) 


163 1 


(3.7) 


184 1 


(2.9) 


206 1 


(2.1) 


227 ( 


(2.1) 


244 ( 0.6) 


1992 


Colorado 


223 < 


(4.3) 


184 1 


(9.4) 


203 1 


(8.3) 


225 1 


(8.7) 


246 1 


(2.5) 


257 (10.0) 




West 


232 I 


(3.1) 


193 < 


(8.5) 


213 1 


(8.1) 


233 1 


(5.8) 


254 1 


(4.2) 


271 ( 9.7) 




Nation 


233 < 


(2.5) 


193 < 


(5.5) 


215 1 


(6.1) 


234 1 


(3.0) 


254 1 


(5.2) 


270 ( 5.1) 


1996 


Colorado 


226 


(4.0) 


166 < 


(9.2) 


206 1 


(5.8) 


227 1 


(9.6) 


245 1 


(3.0) 


262 (21.3) 




West 


226 


(6.5) 


187 


(8.9) 


2061 


(8.1) 


226 1 


(8.5) 


244 1 


(6.6) 


265 (25.5) 


Nation 

American Indian 


231 < 


(4.6) 


192 < 


(9.3) 


212 1 


(6.0) 


232 1 


(7.3) 


248 1 


(6.0) 


273 ( 6.9) 


1992 


Colorado 


215 


(4.4) 


178 (12.3) 


196 


(5.3) 


215 


(3.3) 


234 1 


(5.1) 


249 ( 6.6) 




West 


••• 




••• 1 


r.*) 


••• I 


(•*.•) 


••• 1 


(•*.•) 


... 1 


(•*.*) 


••• 




Nation 


210(3.5) 


171 ( 5.6) 


193(3.5) 


209 ( 1.2) 


228 ( 7.3) 


250 ( 5.7) 


1996 


Colorado 


219(2.9) 


166 ( 3.3) 


199(3.9) 


219 ( 4.7) 


235 ( 1.5) 


253 ( 6.3) 




West 


217(2.6) 


185 (16.1) 


202 ( 7.1) 


218 ( 7.8) 


233 ( 6.7) 


249 ( 7.6) 




Nation 


216(2.5) 


182 ( 7.8) 


199 ( 6.5) 


216 ( 5.0) 


234 ( 3.3) 


247 ( 2.9) 



The NAEP mathematics scale ranges from 0 to 500. Results are reported for raciaVethnic subgroups meeting established 
sample size requirements (see Appendix A). The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly Idgher Gower) than the value for 1992 at about the 95 percent confidence level. ! Interpret with caution 
— the nature of the sample does not allow accurate determination of the variability of this statistic. *** Sample size is 
insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Table 2.2B shows the distribution of mathematics scale scores for White, Black, 
Hispanic, and Asian/Pacific Islander eighth-grade public school students in Colorado, the 
West region, and the nation.^* 

1996, Public School Students, Grade 8 
White students in Colorado demonstrated an average mathematics scale 
score that was higher than that of Black and Hispanic students but was 
not significantly different from that of Asian^acific Islander students. 

1992 vs. 1996, Public School Students, Grade 8 
From 1992 to 1996, there was an increase in the average scale score of 
. White students in Colorado. From 1992 to 1996, there was no 
significant change in the average scale score of Black or Hispanic 
students in Colorado. 

1990 vs. 1996, Public School Students, Grade 8 
From 1990 to 1996, there was an increase in the average scale score of 
White, Black, and Hispanic students in Colorado. 



26 



o 

ERIC 



Results are reported for racial/ethnic subgroups meeting established sample size requirements (see Appendix A). 
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TABLE 2.2B - GRADE 8 


Distribution of Mathematics Scale Scores for Public School 
Students by Race/Ethnicity 


State Assessment 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



WhHe 




















1990 


Colorado 


274 


1.0) 


235 ( 1.9) 


254 ( 1 ,2) 


275 ( 1.7) 


295 ( 1.0) 


313 


(1.1) 




West 


269 


(3.3) 


223 ( 3.2) 


247 ( 2.6) 


268 ( 4.8) 


292 ( 5.8) 


315 


(3.5) 




Nation 


270 


1.5) 


226( 1.3) 


248 ( 1.8) 


271 (2.1) 


293 ( 1.6) 


311 1 


(2.5) 


1992 


Colorado 


278 


1.0)« 


238 ( 1.9) 


259 ( 1 .3) 


280 ( 1.6) 


300 ( 1.3) 


316 


( 1.0) 




West 


277 


(2.4) 


235 ( 2.5) 


256 ( 3.5) 


278 ( 2.7) 


301 ( 2.7) 


319 


(4.6) 




Nation 


277 


(1.1)» 


234 ( 1 4)« 


254 ( 1.6) 


278 ( 1.4) 


300 ( 1.2)» 


318 I 


(2.2) 


1996 


Colorado 


283 


1.0)»> 


243 ( 1.7)» 


263 ( 0.7)« 


284 ( 1.2)» 


304 ( 1.6)« 


321 


(1.4)« 




West 


280 < 


( 2.3)» 


239(2.1)» 


260 ( 1.6)« 


281 ( 2.5) 


304 ( 1 .4) 


321 1 


( 5.4) 




Nation 


281 < 


(1.4)» 


239 ( 1.9)»» 


260 ( 1.4)» 


282 ( 1.6)» 


304 ( 1 .4)» 


322 1 


(2.2) 


Black 




















1990 


Colorado 


237 


(3.1)1 


199 (13.2)1 


216 (4.1)1 


236 ( 4.0)1 


258 ( 6.6)1 


275 1 


( 9.2)! 




West 


245 1 


( 5.9)1 


200 ( 8.8)1 


220 (13.0)1 


240 ( 8.7)1 


271 (14.9)1 


297 1 


( 3.2)! 




Nation 


237 


( 2.8) 


194(7.5) 


214 (5.3) 


236 ( 1.7) 


259 ( 3.0) 


284 1 


(3.5) 


1992 


Colorado 


242 < 


(4.4) 


200 ( 3.8) 


221 ( 5.9) 


241 ( 6.6) 


263 ( 7.8) 


282 1 


(6,6) 




West 


235 < 


(3.5) 


193 (13.3) 


213 ( 2.7) 


235 ( 3.6) 


258 (13.4) 


277 I 


(5.8) 




Nation 


237 


(1.3) 


198 ( 2.0) 


216 ( 1.7) 


237 ( 1.6) 


258 ( 1 .6) 


275 I 


(3.5) 


1996 


Colorado 


255 


( 2.8)« 


216 ( 4.3) 


234 ( 3.1)»» 


254 ( 5.9) 


274 ( 4.2) 


294 1 


(4.8) 




West 


246 < 


( 2.4)1 


205 ( 4.4)1 


226 ( 2.6)l> 


246 ( 7.9)1 


267 ( 2.0)1 


285 1 


( 2.5)1 


Nation 

Hispanic 


242 < 


(2.1) 


200 ( 3.5) 


220 ( 3.0) 


242(2.1) 


264 ( 3.2) 


285 1 


(2.7) 


1990 


Colorado 


247 


( 1.4) 


205 ( 4.6) 


226(3.1) 


248 ( 1 .8) 


268 ( 1.0) 


286 


(2.7) 




West 


244 1 


(3.4) 


200 ( 4.2) 


219 ( 3.5) 


243 (10.5) 


268 ( 2.4) 


286 


(7.5) 




Nation 


242 I 


(2.8) 


198 ( 2.5) 


218 ( 2.9) 


243 ( 5.5) 


268 ( 2.3) 


284 


(2,3) 


1992 


Colorado 


255 


( 1.6)>> 


214 ( 5,4) 


233 ( 2.9) 


255 ( 1 ,0)»» 


276 ( 2.2) 


295 


( 1-3) 




West 


247 


( 1.6) 


204 ( 4,1) 


223 ( 3.2) 


247 ( 2,0) 


271 ( 2.2) 


292 


(1-1) 




Nation 


245 1 


( 1.3) 


203 ( 2,0) 


222 ( 2,1) 


245(2,1) 


269 ( 2.1) 


289 


( 1-6) 


1996 


Colorado 


257 


( 2.3)« 


218 ( 4,5) 


234 ( 4,1) 


256 ( 2.1) 


278 ( 3.7) 


298 


( 2,7)« 




West 


249 


( 2.5) 


201 ( 6,8) 


224 ( 2,9) 


249 ( 3.3) . 


274 ( 3.0) 


294 


(4,9) 


Nation 

Aslan/Pacific Islander 


250 < 


(2.1) 


202 ( 4.0) 


225 ( 2,0) 


250 ( 1.8) 


275 ( 2.0) 


295 


(2.4) 


1990 


Colorado 


*** 1 


rn 


*** 


*** 


*** 


*** 


*** 1 


(**.*) 


1992 


Colorado 


*** 1 


r*.*) 


*** 


*** 


*** 


*** 


.** , 


(**-*) 


1996 


Colorado 


287 ( 4,9) 


252 ( 4,2) ' 


263 ( 7,9) 


289 (10.0) 


308 ( 4.4) 


325 (11.4) 



The NAEP mathematics scale ranges from 0 to 500, Results are reported for racial/ethnic subgroups meeting established 
sample size requirements (see Appendix A). The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation » («) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1990 at about the 95 percent confidence level. If the notation > (<) 
appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 at 
about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990, 1992, 
and 1996 Mathematics Assessments. 
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Students’ Reports of Parents’ Highest Education Level 

Students were asked to indicate the level of education completed by each parent. 
Four levels of education were identified: did not finish high school, graduated high 
school, some education after high school, and graduated college. A choice of “I don’t 
know” was also available. For this analysis the highest education level reported for 
either parent was used. 

In general, results show that with each increment in reported parental education, 
student performance increases significantly. In reviewing these results, it is important 
to note that nationally, approximately one third of fourth graders and one tenth of eighth 
graders did not know the level of education that either of their parents had completed. 
For public school students in Colorado, the percentages were 35 percent for fourth 
graders and 10 percent for eighth graders. Despite the fact that some research has 
questioned the accuracy of student-reported data from similar groups of students,^^ past 
NAEP assessments in mathematics, as well as other subject areas, have found that 
student-reported level of parental education exhibits a consistent positive relationship 
with student performance on the assessments.^® Other research has also replicated 
NAEP findings. 

Table 2.3A shows the results for fourth-grade public school students who reported 
that neither parent graduated from high school, at least one parent graduated from high 
school, at least one parent had some education after high school, at least one parent 
graduated from college, or that they did not know their parents’ highest education level. 
The following discussion pertains to those students who reported knowing the 
educational level of one or both parents. 

1996y Public School StudentSy Grade 4 
The average mathematics scale score of students in Colorado who 
reported that neither parent graduated from high school did not differ 
significantly from that of students who reported that at least one parent 
graduated from high school but was lower than that of students who 
reported that at least one parent had some education after high school 
or at least one parent graduated from college. 

1992 vs. 1996y Public School StudentSy Grade 4 
The ..average scale score of students in Colorado who reported that 
neither parent graduated from high school, at least one parent graduated 
from high school, at least one parent had some education after high 
school, or at least one parent graduated from college did not change 
significantly between 1992 and 1996. 



Looker, E.D. “Accuracy of Proxy Reports of Parental Status Characteristics,” in Sociology of Education, 62(4), pp. 
257-276, 1989. 

“ Reese, C.M., K.E. Miller, J. Mazzeo, and J.A. Dossey. NAEP 1996 Mathematics Report Card. (Washington, DC: 
National Center for Education Statistics, 1997); Campbell, J.R., P.L. Donahue, C.M. Reese, and G.W. I^llips. NAEP 
1994 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education Statistics, 
1996); Beatty, A.S., C.M. Reese, H.R. Persky, and P. Carr. NAEP 1994 V.S. History Report Card. (Washington, DC: 
National Center for Education Statistics, 1996); Persky, H.R., C.M. Reese, C.Y. O'Sullivan, S. Lazer, J. Moore, and 
S. Shakrani. NAEP 1994 Geography Report Cartf. (Washington, DC: National Center for Education Statistics, 1996). 

National Education Longitudinal Study. National Education Longitudinal Study of 1988: Base Year Student Survey. 
(Washington, DC: National Center for Education Statistics, 1995). 



THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



51 



Colorado 



THE h 
REPORT 
CARD 

1996 


lAfiON 

bvaep 

=4f 


s 

1 

V 


TABLE 2.3A - GRADE 4 


Distribution of Mathematics Scale Scores by Public School 
Students ’ Reports of Parents ’ Highest Education Level 


State Assessment 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



Did not finish high school 
















1992 Colorado 


202 ( 2.5) 


165 


(5.8) 


182 ( 2.2) 


201 ( 3.4) 


222 ( 6.3) 


240 ( 5.5) 


West 


203 ( 5.0) 


167 


(16.3) 


185 (10.8) 


203 ( 4.2) 


223 ( 7.0) 


237(6.1) 


Nation 


204 ( 2.6) 


166 


(5.1) 


186 ( 3.0) 


205 ( 3.9) 


224 ( 4.8) 


241 (5.6) 


1996 Colorado 


208 ( 3.8) 


170 


(5.4) 


189 ( 6.8) 


208 ( 4.3) 


230 ( 8.0) 


251 ( 5.9) 


West 


*** 


*** 


(**.*) 


*** (**.*) 


*** 


*** 


••• 


Nation 


205 ( 2.5) 


170 


(8.6) 


185 ( 5.6) 


205 ( 1.8) 


224 ( 4.8) 


240 ( 4.6) 


Graduated from high school 
















1992 Colorado 


214 ( 1.9) 


177 


( 4.8) 


197 ( 3.6) 


215 ( 5.1) 


234 ( 2.5) 


247 ( 3.9) 


West 


218 (2.4) 


181 


(6.4) 


200 ( 5.4) 


220 ( 2.3) 


238 ( 2.9) 


252 ( 3.6) 


Nation 


214 ( 1.6) 


174 


(3.0) 


193 ( 2.8) 


216 ( 1.5) 


234 ( 1.5) 


252 ( 2.7) 


1998 Colorado 


217 ( 2.2) 


180 


(2.9) 


200 ( 4.3) 


219 ( 1.5) 


236 ( 4.9) 


253 ( 2.7) 


West 


218 ( 3.4) 


180 


( 1.9) 


197(3.1) 


219 (17.1) 


239 ( 2.6) 


256 ( 4.7) 


Nation 


218 ( 1.7) 


178 


(3.7) 


198 ( 1.6) 


220 ( 2.1) 


240 ( 1.6) 


255 ( 2.0) 


Some education after HS 
















1992 Colorado 


229 ( 1.9) 


191 


(4.1) 


212 ( 3.9) 


231 ( 2.2) 


247 ( 2.3) 


264 ( 6.3) 


West 


220 ( 2.2) 


173 


(3.9) 


197 ( 4.1) 


226 ( 6.9) 


244 ( 2.4) 


257 ( 2.2) 


Nation 


224 ( 1.7) 


181 


( 1.5) 


204 ( 3.8) 


228 ( 2.0) 


246 ( 2.3) 


260 ( 2.6) 


1998 Colorado 


233 ( 2.0) 


202 


(3.8) 


217(2.2) 


233 ( 5.5) 


250 ( 1.5) 


264 ( 6.2) 


West 


228 ( 3.5) 


196 


(13.7) 


214 ( 5.6) 


230 ( 3.3) 


244 ( 2.4) 


257 ( 5.8) 


Nation 


232 ( 1.7)> 


197 


( 2.8)> 


216 ( 6.1) 


233 ( 1.1) 


250 ( 2.7) 


265 ( 3.6) 


Graduated from college 
















1992 Colorado 


229 ( 1.2) 


191 


( 1.3) 


21 1 ( 2.6) 


230 ( 1.6) 


249 ( 2.3) 


266 ( 1.6) 


West 


225 ( 2.3) 


180 


(4.5) 


204 ( 2.3) 


228 ( 3.0) 


247 ( 2.7) 


264 ( 4.6) 


Nation 


226 ( 1.1) 


181 


(3.2) 


205 ( 1.5) 


228 ( 2.1) 


248 ( 1.5) 


266 ( 2.0) 


1998 Colorado 


234 ( 1.3) 


195 


(3.2) 


216 ( 2.2) 


236 ( 1.1) 


254 ( 1.1) 


269 ( 1.3) 


West 


227 ( 2.9) 


188 


(2.2) 


207 ( 3.7) 


228 ( 3.7) 


247 ( 3.4) 


266 ( 3.3) 


Nation 


230 ( 1.6) 


188 


(2.9) 


210 ( 1.2) 


232 ( 2.1) 


251 ( 1.4) 


268 ( 1.6) 


1 don’t know 
















1992 Colorado 


214 ( 1.2) 


175 


(3.3) 


195 ( 2.2) 


216 ( 1.3) 


235 ( 1 .7) 


252 ( 1.6) 


West 


213 ( 1.8) 


172 


(2.1) 


192 ( 2.0) 


214 ( 2.4) 


234 ( 2.6) 


253 ( 3.6) 


Nation 


213 ( 0.9) 


173 


( 1.4) 


193 ( 1.0) 


214 ( 1.3) 


235 ( 1.5) 


252 ( 1.6) 


1998 Colorado 


218 ( 1.3) 


183 


(1.2) 


201 ( 1.9) 


219 ( 1.4) 


237 ( 1.9) 


253 ( 2.6) 


West 


21 1 ( 3.2) 


166 


(7.9) 


188 ( 3.6) 


212 (4.0) 


234 ( 3.1) 


251 ( 4.3) 


Nation 


216 ( 1.5) 


175 


(4.6) 


196 ( 2.3) 


218 ( 1.3) 


238 ( 1.2) 


255 ( 2.4) 



The NAEP niathematics scale ranges from 0 to 500. Results are reported for parental education subgroups meeting 
established sample size requirements (see Appendix A). The standard errors of the statistics appear in parentheses. It 
con be said with about 95 percent confidence that, for each population of interest, the value for the entire population is 
within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If ±e notation > (<) appears, it signifies that the value for public school 
students was significantly higher (lower) than the' value for 1992 at about the 95 percent confidence level. *** Sample 
size is insufficient to pennit a reliable estimate. , 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Table 2.3B presents results for eighth-grade students by students’ reports of 
highest level of parental education. As with fourth-grade results, discussion focuses on 
those students who reported an educational level for one or both parents. 

1996, Public School Students, Grade 8 
The average mathematics scale score of students in Colorado who 
reported that neither parent graduated from high school was lower than 
that of students who reported that at least one parent graduated from 
high school, at least one parent had some education after high school, 
or at least one parent graduated from college. 

1992 vs. 1996, Public School Students, Grade 8 
Students in Colorado who reported that at least one parent graduated 
from college had a higher average scale score in 1996 than in 1992. 

The average scale score of students in Colorado who reported that 
neither parent graduated from high school, at least one parent graduated 
from high school, or at least one parent had some education after high 
school did not change significantly between 1992 and 1996. 

1990 vs. 1996, Public School Students, Grade 8 
Students in Colorado who reported that at least one parent graduated 
from high school, at least one parent had some education after high 
school, or at least one parent graduated from college had a higher 
average scale score in 1996 than in 1990. The average scale score of 
students in Colorado who reported that neither parent graduated from 
high school did not change significantly between 1990 and 1996. 
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TABLE 2.3B — GRADE 8 


Distribution of Mathematics Scale Scores by Public School 
Students* Reports of Parents* Highest Education Level 


State Assessment 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



Did not finish high school 
1990 Colorado 


243 ( 2.5) 


201 (12.7) 


224 (2.1) 


245 ( 3.4) 


264 ( 2.3) 


280 (17.0) 




West 


245 ( 3.7) 


206 (11.6) 


224 ( 3.6) 


245 ( 4.0) 


266 ( 3.5) 


284 (14.6) 




Nation 


241 ( 2.0) 


204 ( 4.7) 


223 ( 1 .9) 


242 ( 4.0) 


261 ( 3.9) 


277 ( 3.0) 


1992 


Colorado 


251 ( 2.3) 


212 ( 1.6) 


230 ( 3.7) 


252 ( 5.2) 


274 ( 4.5) 


291 ( 3.1) 




West 


249 ( 2.4) 


206 ( 5.9) 


227 ( 4.0) 


248 ( 5.9) 


274 ( 4.6) 


291 ( 5.3) 




Nation 


249 ( 1.8)« 


209 ( 2.6) 


227 ( 1.4) 


246 ( 3.5) 


271 ( 2.0) 


291 ( 2.7)»» 


1996 


Colorado 


247 ( 3.3) 


212 ( 9.6) 


229 ( 7.2) 


246 ( 2.5) 


264 ( 4.1) 


281 ( 6.0) 




West 


257 ( 3.0) 


212 ( 7.1) 


233 ( 7.0) 


260 ( 3.3) 


280 ( 6.4) 


300 ( 5.3) 




Nation 


254 ( 1.9)» 


210 ( 4.2) 


231 ( 3.1) 


257 ( 1.7)» 


278 ( 5.7) 


296 ( 5.5) 


Graduated from high schooi 
1990 Colorado 


254 ( 1.5) 


214 (2.4) 


232 ( 2.1) 


254 ( 1 .5) 


276(2.5) 


295 ( 3.2) 




West 


249 ( 2.6) 


207 ( 5.4) 


227 ( 3.5) 


252 ( 2.6) 


271 ( 5.0) 


290 ( 5.6) 




Nation 


255 ( 1.5) 


212 ( 3.4) 


233 ( 2.2) 


255 ( 1 .3) 


277 ( 3.6) 


297 ( 1.5) 


1992 


Colorado 


261 ( 1.5)» 


221 (2.8) 


241 ( 3.2) 


262 ( 2.5) 


281 ( 1.5) 


299 ( 2.0) 




West 


253 ( 2.9) 


207 ( 5.3) 


230 ( 3.1) 


254 ( 5.6) 


277 ( 3.0) 


298 ( 5.3) 




Nation 


257 ( 1 .3) 


213(2.2) 


234 ( 1.4) 


257 ( 1 .6) 


281 ( 1.9) 


299 ( 1 .7) 


1996 


Colorado 


264 ( 1 .6)» 


225 ( 4.1) 


245 ( 2.6)» 


265 ( 1.5)« 


283 ( 1.7) 


303 (2.1) 




West 


256 ( 2.9) 


212 ( 3.8) 


234 ( 3.8) 


258 ( 4.6) 


277 ( 4.4) 


297 ( 1 .8) 




Nation 


260 ( 1.3)*> 


215 ( 1.9) 


238 ( 1.5) 


262 ( 1.9) 


284 ( 1.0) 


303 ( 2.5) 


Some education after HS 
1990 Colorado 


271 ( 1 .3) 


234 ( 2.3) 


251 ( 1.3) 


272 ( 2.7) 


290 ( 1 .7) 


308 ( 6.7) 




West 


269 ( 2.9) 


224 (18.3) 


249 ( 4.8) 


269 ( 5.6) 


288 (4.1) 


312 (13.4) 




Nation 


267 ( 1 .6) 


222 ( 6.4) 


245 ( 1.9) 


268 ( 1 .9) 


289 ( 2.2) 


305 ( 1.4) 


1992 


Colorado 


276 ( 1.5) 


240 ( 3.1) 


258 ( 1.6) 


277 ( 1.9) 


296 ( 1.8) 


312 (2.1) 




West 


274 ( 2.6) 


232 ( 3.6) 


253 ( 4.6) 


274 ( 2.5) 


297(2.1) 


317(4.8) 




Nation 


270 ( 1.2) 


227 ( 1.7) 


249 ( 1 .7) 


270 ( 3.1) 


293 ( 1.1) 


314 ( 1.7)» 


1998 


Colorado 


280 ( 1.7)» 


244 ( 4.6) 


261 ( 1.8)» 


280 ( 1 .8) 


300 ( 1.7)« 


316 ( 2.3) 




West 


278 ( 2.4) 


238 ( 1 .7) 


257 ( 4.0) 


280 ( 4.7) 


298 ( 3.0) 


317(4.7) 




Nation 


279 ( 1.5)>» 


239 ( 1.6)> 


258 ( 2.6)» 


280 ( 2.2)y> 


300 ( 2.2) 


318 ( 3.3)« 


Graduated from coilege 
1990 Colorado 


277 ( 1.2) 


238 ( 2.0) 


257 ( 1.4) 


278 ( 1 .4) 


299 ( 1.9) 


317 ( 4.1) 




West 


273 ( 2.8) 


223 ( 3.9) 


248 ( 6.5) 


274 ( 2.9) 


298 ( 2.5) 


319 (5.9) 




Nation 


274 ( 1.6) 


226 ( 2.4) 


252 ( 1 .2) 


277 ( 1.5) 


299 ( 1.8) 


318 ( 2.8) 


1992 


Colorado 


282 ( 1.3)» 


240 ( 3.4) 


262 ( 2.2) 


285 ( 1.4)» 


305 ( 1 .5) 


320 ( 1 .0) 




West 


280 ( 2.6) 


233 ( 4.4) 


257 ( 1.8) 


281 ( 4.3) 


304 ( 2.5) 


324 ( 1 .8) 




Nation 


279 ( 1.4) 


231 (2.1) 


255 ( 2.9) 


282 ( 1 .8) 


305 ( 2.4) 


324 ( 1.8) 


1996 


Colorado 


287 ( 1.3)«> 


247 ( 1 .7)» 


267 ( 1.9)» 


290 ( 1.8)» 


309 ( 1.3)» 


325 ( 1.3) 




West 


280 ( 2.5) 


233 ( 4.8) 


258 ( 3.5) 


282 ( 2.6) 


306 ( 2.7) 


324 ( 4.3) 




Nation 


281 ( 1.8)» 


232 ( 3.2) 


258 ( 1 .5) 


283 ( 1 .7) 


307 ( 1.9) 


326 ( 3.0) 


i don’t know 
1990 Colorado 


249 ( 2.5) 


203 (16.5) 


227 ( 7.2) 


251 ( 3.1) 


274 ( 3.5) 


291 ( 3.6) 




West 


241 ( 5.3) 


189 (10.7) 


215 ( 7.7) 


244 (11.1) 


270 ( 6.9) 


290 (11.4) 




Nation 


240 ( 3.3) 


191 ( 6.6) 


215 ( 4.2) 


240 ( 3.2) 


265 ( 4.0) 


287 (10.0) 


1992 


Colorado 


253 ( 2.6) 


213 ( 8.9) 


232 ( 2.2) 


254 ( 2.2) 


276 ( 3.7) 


294 ( 2.5) 




West 


249 ( 2.8) 


206 ( 3.3) 


225 ( 7.1) 


247 ( 4.2) 


274 ( 5.7) 


297 ( 3.6) 




Nation 


251 ( 1.7)« 


208 ( 2.6) 


228 ( 3.6) 


250 ( 2.5) 


275 ( 3.9) 


296 ( 3.3) 


1996 


Colorado 


256 ( 2.7) 


217 ( 3.9) 


233 ( 2.7) 


255 ( 2.9) 


278 ( 3.0) 


297 ( 5.8) 




West 


252 ( 2.7) 


204 ( 5.5) 


228 ( 4.8) 


251 ( 5.7) 


277 ( 5.8) 


298 ( 3.6) 




Nation 


253 ( 1.7)» 


206 ( 4.3) 


229 ( 1.7) 


253 ( 3.7) 


279 ( 2.4) 


298 ( 1.9) 



The NAEP mathematics scale ranges from 0 to 500. Results are reported for parental education subgroups meeting 
established sample size requirements (see Appendix A). The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire population is 
within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standaid error 
of the difference (see Appendix A for details). If the notation » («) appears, it signifies that the value for public school 
students was significantly higher (lower) than the value for 1990 at about the 95 percent confidence level. If the notation 
> (<) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 
at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990, 1992, 
and 1996 Mathematics Assessments. 
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Title I Participation 

The Improving America’s Schools Act of 1994 (P.L. 103-382) reauthorized the 
Elementary and Secondary Education Act of 1965 (ESEA). Title I Part A of the ESEA 
provides local education agencies with financial assistance to meet the educational needs 
of children who are failing or most at risk of failing.^® Title I programs are designed 
to help disadvantaged students meet challenging academic performance standards. 
Through Title I, schools are assisted in improving teaching and learning and in providing 
students with opportunities to acquire the knowledge and skills outlined in their state’s 
content and performance standards. For high poverty Title I schools, all children in the 
school may benefit through participation in school wide programs. Title I funding 
supports state and local education reform efforts and promotes coordinating of resources 
to improve education for all students. 

NAEP first collected student-level information on participation in Title I programs 
in 1994. Therefore, results comparing the performance of participating and 
nonparticipating students are not available for previous NAEP mathematics assessments. 
The NAEP program will continue to monitor the performance of Title I program 
participants in future assessments. The Title I information collected by NAEP refers to 
current participation in Title I services. Students who participated in such services in 
the past but do not currently receive services are not identified as Title I participants. 
Differences between students who receive Title I services and those who do not should 
not be viewed as an evaluation of Title I programs. Typically, Title I services are 
intended for students who score poorly on assessments. To properly evaluate Title I 
programs, the performance of students participating in such programs must be monitored 
over time and their progress must be assessed.^^ 

Table 2.4 presents results for fourth- and eighth-grade students by Title I 
participation. (Results for eighth-grade students participating in Title I programs are not 
reported for Colorado due to the size of the sample.) 

1996, Public School Students, Grade 4 
The average mathematics scale score of students in Colorado who 
received Title I services (195) was not significantly different from that 
of students nationwide (200). The average scale score of Colorado 
students who did not receive Title I services (228) was not significantly 
different from the national average (229). The average scale score of 
Colorado students who received Title I services was lower than that of 
students who did not. 

1996, Public School Students, Grade 8 
The average scale score of Colorado students who did not receive Title 
I services (276) was not significantly different from the national average 
(274). 



U.S. Department of Education, Office of Elementary and Secondary Compensatory Education Programs. Improving 
Basic Programs Operated by Local Education Agencies. (Washington, DC: U.S. Department of Education, 1996). 



For a study of mathematics performance of Title I students in 1991-1992, see U.S. Department of Education, 
PROSPECTS: The Congressionally Mandated Study of Educational Growth and Opportunity, Interim Report: 
Language, Minority and Limited English Proficient Students. (Washington, DC: U.S. Department of Education, 1995). 
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TABLE 2.4 - GRADES 4 AND 8 


Distribution of Mathematics Scale Scores for Public School 
Students by Title I Participation 


State Assassment 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



GRADE 4 














Participatod 














1998 Colorado 


195(2.9) 


164(7.8) 


160 (2.6) 


195 ( 3.6) 


211 (5.6) 


226 ( 6.5) 


West 


200 ( 3.6) 


163(3.5) 


182 (2.7) 


201 ( 4.7) 


221 (3.4) 


238 ( 3.7) 


Nation 


200 ( 1.9) 


164 (2.1) 


161 (1.9) 


200 ( 2.5) 


219(1.6) 


235 ( 2.6) 


Did not participate 














1093 Colorado 


226 ( 1.0) 


191 (3.6) 


210 ( 1.0) 


229(1.0) 


248 ( 1.3) 


264 (1.0) 


West 


226 ( 1 .9) 


167(4.5) 


207 ( 2.4) 


227 ( 2.2) 


245 ( 2.4) 


263 ( 2.1) 


Nation 


229 ( 1.1) 


191 ( 1.2) 


211 ( 1.3) 


231 (1.1) 


249(1.6) 


265 ( 1.2) 


GRADE 8 














Did not participate 














1998 Colorado 


276 ( 1.0) 


233(1.6) 


254(1.1) 


277(1.3) 


300(1.5) 


317(1.3) 


West 


272 ( 1.9) 


226 ( 3.9) 


250 ( 2.0) 


273 ( 2.0) 


297 ( 2.0) 


316 (2.4) 


Nation 


274( 1.3) 


226 ( 3.2) 


252 ( 2.4) 


276 ( 1.3) 


299(1.6) 


316 (2.1) 



The NAEP mathematics scale ranges from 0 to 500. Results are reported for students participating in Title I programs 
only if established sample size requirements are met (see Appendix A). The standard errors of the statistics appear in 
parentheses. It can be said with about 95 percent confidence that, for each population of inteiost, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the 
standard error of the difference (see Appendix A for details). ! Intent with caution — the nature of the sample does 
not allow accurate determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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Free/Reduced>Price Lunch Program Eligibility 

The free/reduced-price lunch component of the National School Lunch Program 
(NSLP), offered through the U.S. Department of Agriculture (USDA), is designed to 
ensure that children near or below the poverty line receive nourishing meals. 

Eligibility for the free/reduced-price lunch program is included as an indicator of 
poverty. The program is available to public schools, nonprofit private schools, and 
residential child care institutions. Eligibility for free or reduced-price meals is 

determined through the USDA’ s Income Eligibility Guidelines. 

NAEP first collected information on student-level eligibility for the federally 
funded NSLP in 1996. Although results cannot be presented for previous NAEP 
mathematics assessments, the NAEP program will continue to monitor the performance 
of these students in future assessments. Table 2.5 shows the results for fourth and eighth 
graders based on their eligibility for this program. 

1996, Public School Students, Grade 4 
The average mathematics scale score of students in Colorado who were 
eligible for free or reduced-price lunch (210) was not significantly 
different from that of students nationwide (207). The average scale 
score of Colorado students who were not eligible for free or 
reduced-price lunch (233) was not significantly different from the 
national average (231). The average scale score of Colorado students 
who were eligible for free or reduced-price lunch was lower than that 
of students who were not. 

1996, Public School Students, Grade 8 
The average mathematics scale score of students in Colorado who were 
eligible for free or reduced-price lunch (259) was higher than that of 
students nationwide (252). The average scale score of Colorado students 
who were not eligible for this service (282) was not significantly 
different from the national average (279). In Colorado, the average 
scale score of students eligible for free or reduced-price lunch was lower 
than that of students who were not eligible for this service. 



U.S. General Services Administration. Catalog of Federal Domestic Assistance. (Washington, DC; Executive Office 
of the President, Office of Management and Budget, 1995). 
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TABLE 2.5 - GRADES 4 AND 8 


CARD 

1998 
State Ass 


essmei 


V 

It 


Distribution of Mathematics Scale Scores for Public School 
Students by Free/Reduced-Price Lunch Eligibility 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



GRADE 4 




- 


Eligible 






1996 Colorado 


210 ( 1.6) 


172 ( 2.9) 191 ( 2.5) 210 ( 1.6) 230 ( 1.2) 247 ( 3.2) 


West 


205 ( 3.6) 


165 ( 6.8) 184 ( 5.2) 205 ( 3.6) 228 ( 5.4) 245 ( 4.2) 


Nation 


207 ( 2.0) 


1 67 ( 3.6) 1 85 ( 2.4) 207 ( 2.3) 230 ( 2.0) 246 ( 1 .2) 


Not eligible 




1996 Colorado 


233 ( 1.0) 


199(2.3) 215( 1.0) 234(0.7) 252( 1.0) 267( 1.4) 


West 


226 ( 1 .7) 


189 ( 1.9) 208 ( 3.0) 228 ( 1.7) 245 ( 2.5) 262 ( 2.6) 


Nation 

Information not available 


231 ( 1.1) 


195 ( 1.6) 213( 1.6) 231 ( 1.3) 249( 1.5) 266( 1.6) 


1996 Colorado 


227 (3.1)1 


1 93 ( 6.0)1 21 1 ( 2.6)1 228 ( 5.6)1 245 ( 2.4)1 259 ( 5.5)1 


West 


225 (10.3)1 


182 (17.2)1 203 (10.3)1 223 ( 6.6)1 247(15.1)1 270(18.7)1 


Nation 


230 ( 4.2)1 


190 ( 7.5)1 211 (6.3)1 232 ( 4.0)1 252 ( 4.0)1 267 ( 5.4)1 


GRADES 

Eligible 






1996 Colorado 


259 ( 1.5) 


219 ( 2.3) 238 ( 2.4) 259 ( 4.2) 281 (2.8) 301 ( 1.6) 


West 


252 ( 2.6) 


208 ( 3.1) 229 ( 3.2) 253 ( 4.2) 274 ( 1.9) 293 ( 2.2) 


Nation 


252 ( 1.5) 


207 ( 2.1 ) 228 ( 1 .7) 252 ( 1 .8) 275 ( 2.6) 294 ( 1 .7) 


Not eligible 




1996 Colorado 


282 ( 1.2) 


242 ( 1.6) 262( 1.4) 283 ( 1.4) 304( 1.5) 321 ( 1.6) 


West 


276 ( 2.3) 


232 ( 5.8) 254 ( 3.9) 277 ( 3.8) 300 ( 1.6) 318 ( 2.0) 


Nation 


279 ( 1.5) 


235 ( 3.1) 257( 1.3) 280 ( 1.6) 303( 1.4) 321 (2.8) 


Information not available 




1996 Colorado 


270 ( 5.2)1 


224 (17.2)1 247 ( 5.9)1 272 ( 6.9)1 296 ( 4.5)1 314 ( 2.2)1 


West 


274 ( 6.0)1 


221 (1 1.0)1 250 ( 8.2)1 276 ( 5.6)1 301 ( 8.8)1 320 ( 8.2)1 


Nation 


278 ( 3.9)1 


229 ( 5.3)1 255 ( 5.7)1 279 ( 4.5)1 304 ( 3.6)1 322 ( 5.7)1 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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Type of Location 

For the purpose of reporting, schools that participated in the assessment were 
classified into three mutually exclusive types of location — Central City, Urban 
Fringe/Large Town, and Rural/Small Town, These classifications are based on 
geographic characteristics of the schools’ locations and are determined by Census 
Bureau definitions of metropolitan statistical areas (MSAs), population size, and density. 
These categories indicate the geographic locations of schools and are not intended to 
indicate or imply social or economic meanings for location types,^^ (The type of 
location classification is described in Appendix A.) 

Table 2.6A presents fourth-grade results according to the location type of the 
schools that students attended for Colorado and the nation, 

1996y Public School Students, Grade 4 
The average mathematics scale score of students attending schools in 
central cities in Colorado was not significantly different from that of 
students in urban fringes/large towns or rural areas/small towns, 

1992 vs. 1996, Public School Students, Grade 4 
From 1992 to 1996, there was no significant change in the average scale 
score of students attending schools in any of the three types of location 
in Colorado, 



In past NAEP reports, a type of community variable that combined community size with a school-level socioeconomic 
indicator was reported. Due to the problematic nature of this variable, NAEP currently reports results by Census-based 
descriptors. 
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TABLE 2.6A - GRADE 4 


Distribution of Mathematics Scale Scores for Public School 
Students by Type of Location 


State Assessment 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



Central city 






1992 Colorado 


217 ( 1.8) 


176 ( 1.6) 196 ( 2.2) 219 ( 2.7) 239 ( 2.6) 258 ( 1.8) 


Nation 


212 ( 1.6) 


168 ( 2.2) 189 ( 3.1) 212 ( 2.1) 235 ( 2.2) 253 ( 2.0) 


1998 Colorado 


223 ( 2.3) 


182 ( 4.1) 202 ( 3.2) 224 ( 3.5) 244 ( 2.5) 263 ( 1.7) 


Nation 


214(2.8) 


170 ( 3.5) 190 ( 3.7) 215 ( 3.5) 238 ( 2.9) 256 ( 2.5) 


Urban frInge/Large town 






1992 Colorado 


224 ( 1.6) 


185 ( 5.0) 205 ( 1.7) 225 ( 1.2) 244 ( 1.7) 261 ( 2.4) 


Nation 


225 ( 1.6) 


1 64 ( 4.0) 205 ( 1 .8) 227 ( 2.4) 247 ( 1.7) 264 ( 1 .4) 


1998 Colorado 


229 ( 1.9) 


192 ( 5.3) 211 ( 3.2) 231 ( 1.9) 249 ( 1.6) 264 ( 2.6) 


Nation 


228 ( 1.7) 


188 ( 3.3) 209 ( 1.8) 229 ( 1.2) 248 ( 2.1) 265 ( 1.7) 


Rural/Small town 






1992 Colorado 


221 ( 1.9) 


182 ( 1.8) 203 ( 2.1) 223 ( 2.3) 241 ( 3.5) 257 ( 1.9) 


Nation 


217(2.0) 


176 ( 2.3) 197 ( 5.0) 219 ( 2.3) 238 ( 1.2) 255 ( 2.2) 


1998 Colorado 


226 ( 2.3) 


190 ( 4.4) 207 ( 3.5) 226 ( 3.2) 245 ( 2.4) 260 ( 2.2) 


Nation 


222 ( 1.9) 


1 83 ( 3.4) 202 ( 2.2) 223 ( 3.0) 243 ( 2.2) 258 ( 1 .3) 



The NAEP mathematics sc^e ranges from 0 to 500. Results are reported for type of location subgroups meeting 
established sample size requirements (see Appendix A). The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire population is 
within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students was significantly higher Gower) than the value for 1992 at about the 95 percent confidence level. Characteristics 
of the school sample do not permit reliable regional results for type of location. ! Interpret with caution — the nature 
of the sample does not allow accurate determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Table 2.6B presents eighth-grade results according to the location type of the 
schools for Colorado and the nation. (Type of location results are not available for the 
NAEP 1990 mathematics assessment.) 

1996y Public School Students, Grade 8 
The average mathematics scale score of students attending schools in 
central cities in Colorado was not significantly different from that of 
students in urban ftinges/large towns or rural areas/small towns. 

1992 vs, 1996, Public School Students, Grade 8 
From 1992 to 1996, there was no significant change in the average scale 
score of students attending schools in any of the three types of location 
in Colorado. 
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TABLE 2.6B - GRADE 8 



Distribution of Mathematics Scale Scores for Public School 
Students by Type of Location 





Average 
Scale Score 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


00th 

Percentile 














Central city 














1992 Colorado 


270 ( 1.6) 


222 (4.1) 


246 ( 2.2) 


271 ( 1 .6) 


295 ( 1.6) 


315 ( 2.3) 


Nation 


256 ( 2.6) 


209 ( 3.5) 


232 ( 2.9) 


256 ( 3.5) 


284 ( 3.1) 


307 ( 2.5) 


1998 Colorado 


273 ( 2.0) 


229 ( 3.4) 


250 ( 2.4) 


274 ( 2.6) 


296 ( 1.7) 


316 ( 1.3) 


Nation 


260 ( 2.5) 


210 ( 2.3). 


233 ( 2.7) 


260 ( 2.1) 


286 ( 2.9) 


310 ( 3.6) 


UrtMin frInge/Large town 














1992 Colorado 


274 ( 1.6) 


233 ( 2.2) 


254 ( 1 .6) 


276 ( 1.3) 


296 ( 1.6) 


313 (1.6) 


Nation 


274 ( 2.0) 


226 ( 2.0) 


249 ( 2.9) 


275 ( 2.5) 


299 ( 2.4) 


320 (1.6) 


1998 Colorado 


276 ( 2.0) 


236 ( 3.7) 


256 ( 2.5) 


260 ( 1.6) 


301 ( 2.7) 


319 ( 2.2) 


Nation 


274 ( 2.6) 


226 ( 4.1) 


250 ( 3.3) 


275 ( 3.6) 


300 ( 3.5) 


320 ( 4.1) 


Rural/Small town 














1992 Colorado 


273 ( 2.4) 


232 ( 4.6) 


254 ( 2.3) 


275(2.1) 


295 ( 2.9) 


312 ( 4.4) 


Nation 


266 ( 1.5) 


223 ( 1.7) 


243 ( 2.7) 


266 ( 1.5) 


290 ( 2.0) 


309 ( 2.3) 


1998 Colorado 


274 ( 2.5) 


232 ( 4.0) 


255 ( 2.2) 


275 ( 1.9) 


296 ( 2.1) 


312 ( 2.4) 


Nation 


276 ( 2.0)> 


233 ( 4.9) 


256 ( 2.7)> 


276 ( 1.6)> 


299 ( 2.0) 


316 ( 1.7) 



The NAEP mathematics scale ranges from 0 to 500. Results are reported for type of location subgroups meeting 
established sample size requirements (see Appendix A). The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confrdence that, for each population of interest, the value for the entire population is 
within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students was significantly higher Gower) than the value for 1992 at ^out the 95 percent confidence level. Characteristics 
of the school sample do not permit reliable regional results for type of location. ! Interpret with caution — the nature 
of the sample does not allow accurate determination of the variability of this statistic. *** Sample size is insufficient 
to permit a reliable estimate. 

SOURCE; National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Type of School 

The NAEP 1996 state assessment marks the first time that nonpublic school 
students were assessed in mathematics at the state level. Therefore, separate nonpublic 
school results can be reported for Colorado at grade 4. (Colorado did not meet minimum 
participation guidelines for reporting nonpublic school results for grade 8.) Also, results 
based on a combined sample of public and nonpublic school students can be presented. 
(Trend results are not presented for nonpublic school students because they were not 
included in previous state-level NAEP assessments of mathematics.) 

In 1996, approximately 93 percent of fourth graders in Colorado attended public 
schools, with the remaining students attending nonpublic schools (including Catholic and 
other private schools). For the nation, 89 percent of students at grade 4 attended public 
schools in 1996. 

Previous NAEP mathematics assessments and other survey research on educational 
achievement have found significant differences in the performance of students attending 
public and nonpublic schools.^ However, the reader is cautioned against using NAEP 
results to make simplistic inferences about the relative effectiveness of public and 
nonpublic schools. Average performance differences between the two types of schools 
may, in part, be related to socioeconomic and sociological factors, such as levels of 
parental involvement in their child’s education. To get a clearer picture of the 
differences between public and nonpublic schools, more in-depth investigations must 
be conducted that are beyond the scope of the NAEP state assessment program. 

Table 2.7 shows the distribution of mathematics scale scores for the public, 
nonpublic, and combined fourth-grade populations in Colorado, the West region, and the 
nation. 



1996, Nonpublic School Students, Grade 4 
The average mathematics scale score of students attending nonpublic 
schools in Colorado (223) was not significantly different from* that of 
nonpublic school students across the nation (237). 

1996, Public vs. Nonpublic School Students, Grade 4 
In Colorado, the average scale score of public school students (226) was 
not significantly different from that of nonpublic school students (223). 

1996, Public and Nonpublic School Students Combined, Grade 4 
The average mathematics scale score of public and nonpublic school 
students combined in Colorado (226) was not significantly different 
from that of students nationwide (224). 



• Although the difference may appear large, recall that “significance” here refers to “statistical significance.” 

34 

Campbell, J.R., C.M. Reese, C. O’Sullivan, and J.A. Dossey. NAEP 1994 Trends in Academic Progress. (Washington, 
DC: National Center for Education Statistics, 1996); National Education Longitudinal Study. National Education 
Longitudinal Study of 1988: Base Year Student Survey. (Washington, DC: National Center for Education Statistics, 
1995). 



62 



^ ^?HE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



Colorado 



THE » 
REPORT 
CARD 

1896 


lATIDN’S 

raep 




TABLE 2.7 - GRADE 4 


Distribution of Mathematics Scale Scores for Students by 
Type of School 


State Assessment 



Average 


10th 


25th. 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



Public 














1998 Colorado 


226(1.0) 


187(2.1) 


207 ( 1.2) 


227 ( 1.5) 


247 ( 1.3) 


263(1.3) 


West 


219(2.1) 


177(4.0) 


197 ( 2.0) 


220 ( 2.9) 


240 ( 2.6) 


259 ( 2.1) 


Nation 


222(1.0) 


180 ( 1.5) 


201 ( 1.3) 


224 ( 1.3) 


244 ( 1.0) 


261(1.0) 


Nonpublic 














1996 Colorado 


223 ( 5.8) 


186 ( 9.3) 


206 ( 8.0) 


226 ( 4.8) 


243 ( 9.3) 


256 ( 4.5) 


West 


236 ( 8.2)1 


193 (15.1)1 


215 ( 9.8)! 


238 ( 7.2)1 


258 (10.4)1 


276(8.3)1 


Nation 


237 ( 1.9) 


202 ( 5.7) 


219 (2.6) 


238 ( 1.8) 


255 ( 1.3) 


270 ( 2.4) 


Combined 














1996 Colorado 


226(1.0) 


187(2.1) 


207 ( 1.3) 


227 ( 1.4) 


246 ( 1.3) 


262 ( 1.6) 


West 


220 ( 2.0) 


178 ( 3.8) 


198 ( 1.8) 


221 ( 2.6) 


242 ( 1.6) 


260 ( 1.8) 


Nation 


224 ( 0.9) 


182 ( 1.1) 


204 ( 1.3) 


226 ( 1.0) 


246 ( 0.7) 


263(1.0) 



The NAEP mathematics scale ranges Irom 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that« for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). . ! Intexpret with caution, — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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PART TWO 



The Mathematics Achievement Levei Resuits 
for Fourth- and Eighth-Grade Students 

hile providing information about what students can do in mathematics is 
essential for understanding the current state of mathematics performance, knowing what 
students can do is made even more relevant by also looking at what students should be 
able to do. For that reason, the National Assessment Governing Board (NAGB) has 
provided NAEP with achievement levels in mathematics that set standards for 
performance in mathematics at grades 4, 8, and 12. 

This part of the report presents results using the student achievement levels as 
authorized by the NAEP legislation and adopted by NAGB.’’ The achievement levels 
are based on collective judgments, gathered from a broadly representative panel of 
teachers, education specialists, and members of the general public, about what students 
should know and be able to do relative to a body of content reflected in the NAEP 
mathematics frameworks. For reporting purposes, the achievement level cutscores are 
placed on the traditional NAEP scale. For each grade, the results divide the scale into 
four ranges — Basic, Proficient, Advanced, and the region below Basic. 

Initiated in 1990, the levels have been used to report the national and state results 
in mathematics in 1990 and 1992, as well as in other subjects such as reading, 

U.S. history, and geography. The mathematics achievement levels were developed by 
American College Testing (ACT) under contract with NAGB. While setting student 
achievement levels on NAEP is relatively new and developing, the achievement levels 
are consistent with recent education reform efforts. Some state and local jurisdictions 
are also developing standards and reporting their test results using them.’* 



” P.L. 103-382. Improving America’s Schools Act of 1994. 

’* States such as Kentucky, Maryland, Colorado, Connecticut, and North Carolina all have standard-setting initiatives 
resulting in student achievement levels. 
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Despite the commitment to standards-based reporting of NAEP results, the 
transition is incomplete. There have been some critical reviews and congressionally 
mandated evaluations that cast doubt on the interpretability of achievement levels and 
also on the applicability of the underlying technical methodology used to develop them. 
These studies were conducted by the General Accounting Office (GAO)” and the 
National Academy of Education (NAE).’* Their findings question, for example, the 
application of the Angoff method for large-scale assessments like NAEP, given the 
significant modifications required to accommodate the complexity of the NAEP item 
structure and the multiple cutpoints. They conclude that discretion should be used in 
making particular inferences about what students at each level actually know and can 
do. In addition, there were concerns that the proportion of students at certain levels, 
but particularly at the Advanced levels, may be underestimated. 

On the other hand, the Angoff procedure is the most widely documented, 
researched, and frequently used method in the standard-setting field. Many well-known 
experts support the use of a modified-Angoff method on NAEP. Several critics of the 
NAE studies,” for example, have reaffirmed the integrity of the process employed by 
NAGB and have concluded that the weight of the empirical evidence presented does not 
support the NAE’s conclusions about achievement levels or the use of the 
modified-Angoff process. In addition, the Council of Chief State School Officers’ 
advisory panel of state assessment directors, fully aware of the NAE’s conclusions, 
supported the use of the achievement levels to report NAEP results."'® 

Taken together, the results of the various studies suggest the need for further 
research and development. A standard-setting conference was held in the fall of 1994, 
jointly sponsored by NCES and NAGB. The proceedings, which were recently released, 
show the variety of approaches which can be used to achieve similar goals and the 
general lack of agreement on which approach may constitute the best way.^‘ 



37 

General Accounting Office. Educational Achievement Standards: NAGB *s Approach Yields Misleading 
Interpretations. (Washington, DC: General Accounting Office, 1993). 

38 

National Academy of Education. Setting Performance Standards for Student Achievement. (Stanford, CA: National 
Academy of Education, 1993). 

39 

American College Testing. Technical Report on Setting Achievement Levels on the 1992 National Assessment of 
Educational Progress in Mathematics, Reading, and Writing. (W ashington, DC: National Assessment Governing Board, 
1993); G. Cizek. Reactions to the National Academy of Education Report. (Washington, DC: National Assessment 
Governing Board, 1993); M. Kane. Comments on the NAE Evaluation of the NAGB Achievement Levels. (Washington, 
DC: National Assessment Governing Board, 1993). 

40 

Education Information Advisory Committee of the Council of Chief State School Officers. A Resolution of the 
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In summary, the student achievement levels in this report have been developed 
carefully and responsibly, and have been subject to refinements and revisions in 
procedures as new technologies have become available. However, standards-based 
reporting for NAEP data is still in transition. The NAEP legislation states that the 
student achievement levels shall be . . developed through a national consensus 
approach, . . . used on a developmental basis, . . . and updated as appropriate.” It 
requires that the developmental status of achievement levels be clearly stated in NAEP 
reports. Upon review of the available information, the Commissioner of Education 
Statistics has judged that the achievement levels are in a developmental status. 
However, the Commissioner and NAGB also believe that the achievement levels are 
useful and valuable in reporting on the educational achievement of American students. 

Part Two of this report focuses on results of the NAEP 1996 state assessment 
program in mathematics in terms of the NAGB achievement levels. Chapter 3 provides 
an overview of the achievement level descriptors. In addition, the percentages of public 
school students in Colorado, the West region, and the nation who performed at or above 
each of the achievement levels are presented. Chapter 4 expands on these results by 
presenting achievement level data for subgroups defined by gender, race/ethnicity, 
parental education, location of the school, participation in Title I services and programs, 
and eligibility for the free/reduced-price lunch component of the National School Lunch 
Program. Chapter 4 also presents results for students in nonpublic schools and combined 
results for both public and nonpublic school students. 
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CHAPTER 3 



Students’ Mathematics Achievement Level 
Results 

Achievement levels are based on collective judgments, gathered from a broadly 
representative panel of teachers, education specialists, and members of the general 
public, about what students should know and be able to do relative to the body of content 
reflected in the NAEP mathematics framework (see Appendix B for a description of the 
framework). These judgments translate into specific points on the NAEP scale that 
identify boundaries between levels of achievement — Basic, Proficient, and Advanced 
— for each grade. Performance at the Basic level denotes partial mastery of the 
knowledge and skills that are fundamental for proficient work. Performance at the 
Proficient level, represents solid academic performance. Students reaching this level 
demonstrate competency over challenging subject matter. Performance at the Advanced 
level signifies superior performance beyond proficient grade-level mastery. In this 
report, the percentage of students at or above the three achievement levels, as well as 
the percentage of students below Basic, is presented for fourth- and eighth-grade students 
in Colorado, the West region, and the nation. 

Description of NAEP Mathematics Achievement Leveis 

The achievement levels for the NAEP mathematics assessments were first set in 
1990 and slightly revised following the 1992 mathematics assessment. Appendix D 
briefly describes the process of gathering expert judgments about Basic, Proficient, and 
Advanced performance — as defined by NAGB policy — on each mathematics question. 
The appendix also discusses procedures for combining the various judgments on the 
various questions and mapping them onto the NAEP mathematics scale. The result of 
the achievement level setting process is a set of scale score outpoints used to classify 
students as Basic, Proficient, or Advanced. (Separate outpoints are defined for each 
grade.) The three mathematics achievement levels for grades 4 and 8 are elaborated on 
in Figure 3.1, and examples of questions appropriate at each achievement level are also 
provided. It should be noted that constructed-response questions in the assessment occur 
at all levels of mathematics achievement. 




THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



69 



Colorado 



THE ^ 
REPORT 
CARD 

1996 


lAHON’S 

ivaep 




FIGURE 3.1 




§ 


Mathematics Achievement Levels 


State Assessment 



GRADE 4 

NAEP mathematics content strands: (1) Number Sense, Properties, and Operations; (2) Measurement; (3) 
Geometry and Spatial Sense; (4) Data Analysis, Statistics, and Probability; (5) Algebra and Functions. 
(Note: At the fourth- grade level, algebra and functions are treated in informal and exploratory ways, often 
through the study of patterns.) 



Skills are cumulative across levels — from Basic to Proficient to Advanced. 



BASIC 

LEVEL 


Fourth-grade students performing at the Basic level should show some 
evidence of understanding the mathematical concepts and procedures in the 
five NAEP content strands. In relation to the NAEP mathematics scale, 
Sas/c-level achievement for fourth grade is defined by scale scores at or 
above 214. 


Specifically, fourth graders performing at the Basic level should be able to estimate and use basic facts to 
perform simple computations with whole numbers; show some understanding of fractions and decimals; and 
solve simple real-world problems in all NAEP content strands. Students at this level should be able to use 
— though not always accurately — four-function calculators, rulers, and geometric shapes. Their written 
responses are often minimal and presented without supporting information. 


PROFICIENT 

LEVEL 


Fourth-grade students performing at the Proficient level shoutd consistently 
apply integrated procedural knowledge and conceptual understanding to 
problem solving in the five NAEP confenf strands. In relation to the NAEP 
mathematics scale, ProfrcienMevel achievement for fourth grade is defined 
by scale scores at or above 249. 



Specifically, fourth graders performing at the Proficient level should be able to use whole numbers to 
estimate, compute, and determine whether results are reasonable. They should have a conceptual 
understanding of fractions and decimals; be able to solve real-world problems in all NAEP content strands; 
and use four-function calculators, rulers, and geometric shapes appropriately. Students at the Proficient level 
should employ problem-solving strategies such as identifying and using appropriate information. Their 
written solutions should be organized and presented both with supporting information and explanations of 
how they were achieved. 



ADVANCED 

LEVEL 



Fourth-grade students performing at the Advanced level shoutd apply 
integrated procedural knowledge and conceptual understanding to complex 
and nonroutine real-world problem solving in the five NAEP content strands. 
In relation to the NAEP scale, Advanced-\eve\ achievement for fourth grade is 
defined by scale scores at or above 282. 



Specifically, fourth graders performing at the Advanced level should be able to solve complex and 
nonroutine real-world problems in all NAEP content strands. They should display mastery in the use of 
four-function calculators, rulers, and geometric shapes. These students are expected to draw logical 
conclusions and justify answers and solution processes by explaining why, as well as how, they were 
achieved. They should go beyond the obvious in their interpretations and be able to communicate then- 
thoughts clearly and concisely. 
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1996 






State Assessment 



Mathematics Achievement Levels 



Grade 4 Basic-Level Example Item 



Refer to the rectangle below. (NOTE: Size reduced from original.) 


1 992 Percent Correct 




.... 




Nation 


50 (1 .6) 







Use your centimeter ruler to make the following measurement to the nearest 
centimeter. 

What is the length in centimeters of one of the longer sides of the rectangle? 
Answer: (8 centimeters) 



Grade 4 Proficient-Level Example Item 



Carol wanted to estimate the distance from A lo D along the path shown on the map below. 
She correctly rounded each of the given distances to the nearest mile and then added them. 
Which of the following sums could be hers? 

C 




A. 4 -h 6 + 5 = 15 

B. 5 + 6 + 5 = 16 
*C. 5 + 6 + 6 = 17 

D. 5 + 7 + 6 = 18 



1992 Percent Correct 



Nation 



25 (1.7) 



Grade 4 Advanced-Level Example Item 



If represents the number of newspapers that Lee delivers each day, 

which of the following represents the total number of newspapers that Lee delivers in 5 days? 



A.5 + □ 



5xn 


1992 Percent Correct 


1 

□ 


Nation 


48 (1.4) 



D.(n+D)x5 





THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



71 




Colorado 



THE h 
REPORT 
CARD 

1996 


lAnON' 

bvasf 

4f 


s 

1 

V 


FDQURE 3.1 (continued) 


Mathematics Achievement Levels 


State Assessment 



GRADE 8 

NAEP mathematics content strands: (1) Number Sense, Properties, and Operations; 
(2) Measurement; (3) Geometry and Spatial Sense; (4) Data Analysis, Statistics, and 
Probability; (5) Algebra and Functions. 

Skills are cumulative across all levels — from Basic to Proficient to Advanced. 



BASIC 

LEVEL 



Eighth-grade students performing at the Basic level shouid exhibit evidence 
of conceptual and procedural understanding in the five NAEP content 
strands. This level of performance signifies an understanding of arithmetic 
operations — Including estimation — on whole numbers, decimala, fractions, 
and percents. In relation to the NAEP mathematics scale, 0as/c-level 
achievement for eighth grade la defined by scale scores at or above 262. 



Specifically, eighth graders performing at the Basic level should complete problems correctly with the help 
of structural prompts such as diagrams, charts, and graphs. They should be able to solve problems in all 
NAEP content strands through the appropriate selection and use of strategies and technological tools — 
including calculators, computers, and geometric shapes. Students at this level should also be able to use 
fundamental algebraic and informal geometric concepts in problem solving. 



As they approach the Proficient level, students at the Basic level should be able to determine which of 
available data are necessary and sufficient for correct solutions and use them in problem solving. However, 
these eighth graders may show limited skill in communicating mathematically. 



PROnCIENT 

LEVEL 



Eighth-grade students performing at the Proficient level shouid apply 
mathematical concepts and procedures consistently to complex problems In 
the five NAEP content strands. In relation to the NAEP mathematics scale, 
Prof/c/ent-level achievement for eighth grade Is defined by scale scores at or 
above 299. 



Specifically, eighth graders performing at the Proficient level should be able to conjecture, defend their 
ideas, and give supporting examples. They should understand the connections between fractions, percents, 
decimals, and other mathematical topics such as algebra and functions. Students at the Proficient level are 
expected to have a thorough understanding of basic level arithmetic operations — an understanding 
sufficient for problem solving in practical situations. 

Quantity and spatial relationships in problem solving and reasoning should be familiar to them, and they 
should be able to convey underlying reasoning skills beyond the level of arithmetic. They should be able 
to compare and contrast mathematical ideas and generate their own examples. These students should make 
inferences from data and graphs; apply properties of informal geometry; and accurately use the tools of 
technology. Students at this level should understand the process of gathering and organizing data and be 
able to calculate, evaluate, and communicate results within the domain of statistics and probability. 

Eighth-grade students at the Advanced level should be able to reach beyond 
ADVANCED recognition, Identification, and application of mathematical rules In order 

to generalize and synthesize concepts and principles in the five NAEP content 
LEVEL strands. In relation to the NAEP mathematics scale, Advanced~\eve\ 

achievement for eighth grade is defined by scale scores at or above 333. 



Specifically, eighth graders performing at the Advanced level should be able to probe examples and 
counterexamples in order to shape generalizations from which they can develop models. Eighth graders 
performing at this level should use number sense and geometric awareness to consider the reasonableness 
of an answer. They are expected to use abstract thinking to create unique problem-solving techniques and 
explain the reasoning processes underlying their conclusions. 
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FIGURE 3.1 (continued) 


Mathematics Achievement Levels 



Grade 8 Basic-Level Example Item 



Which of the following is both a multiple of 3 and a multiple of 7? 

A. 7,007 

B. 8,192 
*C. 21,567 

D. 22,287 

E. 40,040 



Did you use the calculator on this question? 

Yes No 



1 992 Percent Correct 



Nation 



76 (1.3) 



Grade 8 Proficient-Level Example Item 





80 




70 


Number 


60 


of 


50 


Sit-ups 


40 




30 



I I I I I I 

10 15 20 25 30 
Age in Years 

In the graph above, each dot shows the number of sit-ups and the 
corresponding age for one of 13 people. According to this graph, what is the 
median number of sit-ups for these 13 people? 



A. 15 

B. 20 

C. 45 



*D. 50 


1992 Percent Correct 


E. 55 


Nation 


23 (1.4) 



Did you use the calculator on this question? 

Yes No 
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FIGURE 3.1 (continued) 


Mathematics Achievement Levels 


State Assessment 



Grade 8 Advanced-Level Example Item 



A 


B 


2 


5 


4 


9 


6 


13 


8 


17 



14 ? 



If the pattern shown in the table were continued, what number would appear 
in the box at the bottom of column B next to 14? 



A. 19 

B. 21 

C. 23 

D. 25 
*E. 29 



1992 Percent Correct 



Nation 



25 (1 .4) 
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Table 3.1 A indicates the percentage of fourth-grade public school students at or 
above each achievement level, as well as the percentage of students below the Basic 
level. 



1996, Public School Students, Grade 4 
In Colorado, 22 percent of students performed at or above the Proficient 
level. This percentage did not differ significantly from that of students 
nationwide (20 percent). 

1992 vs. 1996, Public School Students, Grade 4 
From 1992 to 1996, there was an increase in the percentage of Colorado 
students who attained the Proficient level (17 percent in 1992 and 
22 percent in 1996). 
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TABLE 3.1 A — GRADE 4 


Percentage of Public School Students Attaining Mathematics 
Achievement Levels 


State Assessment 



Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below Basic 



1992 










Colorado 


2 ( 0.4) 


17(1.0) 


61 ( 1.4) 


39 ( 1 .4) 


West 


2 ( 0.6) 


17(2.2) 


57 ( 2.3) 


43 ( 2.3) 


Nation 


2 ( 0.3) 


17(1.1) 


57 ( 1.2) 


43 ( 1.2) 


1996 










Colorado 


2 ( 0.3) 


22 ( 1 .3)> 


67 ( 1.6)> 


33 ( 1 .6)< 


West 


2 ( 0.5) 


16 ( 1.8) 


57 ( 3.0) 


43 ( 3.0) 


Nation 


2 ( 0.3) 


20 ( 1.0) 


62 ( 1.4)> 


38 ( 1.4)< 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students was significantly higher Gower) than the value for 1992 
at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Table 3. IB provides the percentage of eighth-grade public school students at or 
above each achievement level and the percentage of students below the Basic level. 

1996j Public School Students, Grade 8 
In Colorado, 25 percent of students performed at or above the Proficient 
level. This percentage did not differ significantly from that of students 
nationwide (23 percent). 

1992 vs. 1996, Public School Students, Grade 8 
From 1992 to 1996, there was no significant change in the percentage 
of Colorado students who attained the Proficient level (22 percent in 
1992 and 25 percent in 1996). 

1990 vs. 1996, Public School Students, Grade 8 
From 1990 to 1996, the percentage of students who performed at or 
above the Proficient level in Colorado increased (17 percent in 1990 
and 25 percent in 1996). 
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TABLE 3.1B- GRADE 8 


Percentage of Public School Students Attaining Mathematics 


State Assessment 


Achievement Levels 



Advanced 



At or Above 
Proficient 



At or Above 
Basic 



Below Basic 



1990 


















Colorado 


2 1 


(0.4) 


17 ( 


:o.9) 


57 1 


[1.2) 


43( 


[1.2) 


West 


2 1 


(0.6) 


15 ( 


:2.2) 


50 1 


[2.6) 


50 1 


[2.6) 


Nation 


2 1 


(0.4) 


15 ( 


:i.i) 


51 1 


[1.5) 


49 1 


[1.5) 


1992 


















Colorado 


2 1 


(0.4) 


22 1 


[1.2)- 


64( 


[1.4)- 


36 1 


[1.4)« 


West 


3 ( 


(1.0) 


20 1 


[2.0) 


57 ( 


[2.6) 


43 ( 


[2.6) 


Nation 


3 ( 


(0.4) 


20 1 


[1.0)- 


56 1 


[1.2)- 


44 1 


[1.2)« 


1998 


















Colorado 


3( 


(0.5) 


25 1 


[1.3)» 


67 ( 


[1.3)- 


331 


[1.3)« 


West 


3( 


(0.6) 


21 ( 


[2.0) 


58 1 


[2.4) 


42 1 


(2.4) 


Nation 


4( 


(0.6) 


23 1 


[1.2)- 


61 ( 


[1.3)-> 


39 1 


( 1.3)«< 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
» («) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1990 
at alx)ut the 95 percent confidence level. If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher Gower) than the value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990, 1992, 
and 1996 Mathematics Assessments. 
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CHAPTER 4 



Mathematics Achievement Levei Resuits by 
Subpopuiations 



As discussed in Chapter 2 of this report, NAEP assessments have repeatedly 
shown differences in performance for subpopulations of students. This chapter presents 
achievement level results for Colorado, the West region, and the nation for subgroups 
of public school students defined by gender, race/ethnicity, parental education, type of 
location of the students’ schools, participation in Title I programs, and eligibility for the 
free/reduced-price lunch component of the National School Lunch Program. Results for 
students attending nonpublic schools are also reported. (A description of the subgroups 
and how they are defined is presented in Appendix A.) 

As stated in Part One, the reader is cautioned against using NAEP results to make 
simple or causal inferences related to subgroup membership or the effectiveness of 
public and nonpublic schools or Title I programs. ' ' 
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Gender 

Table 4.1 A provides the achievement level results by gender for fourth-grade 
public school students. 



199 6y Public School Students, Grade 4 
The percentage of males in Colorado who performed at or above the 
Proficient level (24 percent) was not significantly different from that 
of females (20 percent). 

1992 vs. 1996, Public School Students, Grade 4 
In Colorado from 1992 to 1996, the percentage of males who attained 
the Proficient level increased while that of females did not change 
significantly. 
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TABLE 4.1 A -GRADE 4 


Percentage of Public School Students Attaining Mathematics 


State Assessment 


Achievement Levels by Gender 



Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below Basic 



Male 


















1992 


Colorado 


2 ( 0.7) 


19 ( 


[ 1.3) 


63 1 


(1.7) 


37 I 


(1.7) 




West 


2 ( 0.7) 


17 ( 


[2.5) 


57 1 


(2.5) 


43 1 


(2.5) 




Nation 


2 ( 0.4) 


19 ( 


[ 1.2) 


59 1 


(1.3) 


41 I 


(1.3) 


1998 


Colorado 


2 ( 0.5) 


24 ( 


[1.5)> 


68 1 


(1-7) 


32 1 


(1.7) 




West 


3 ( 0.9) 


19 ( 


(2.0) 


58 1 


(3.6) 


42 ( 


(3.6) 




Nation 


3 ( 0.5) 


22 1 


[ 1.2) 


63 1 


(1.8) 


37 ( 


(1.8) 


Female 


















1992 


Colorado 


1 ( 0.4) 


16 ( 


[ 1.3) 


591 


[1.7) 


41 ( 


(1.7) 




West 


1 ( 0.7) 


16 ( 


(2.6) 


58 1 


[2.6) 


42 ( 


(2.6) 




Nation 


1 ( 0.3) 


16 ( 


(1.4) 


56 \ 


: 1.8) 


44 1 


(1.8) 


1998 


Colorado 


1 ( 0.4) 


20 1 


(1.9) 


66 { 


[2.2) 


34( 


(2.2) 




West 


1 ( 0.4) 


13 ( 


(1.7) 


56 1 


[3.4) 


44 1 


(3.4) 




Nation 


1 ( 0.4) 


17( 


(1.2) 


61 1 


[1.7) 


39 1 


(1.7) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 
at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Table 4. IB presents achievement level results for male and female eighth graders. 

1996, Public School Students, Grade 8 
The percentage of males who performed at or above the Proficient level 
in Colorado (28 percent) was not significantly different from that of 
females (23 percent). 

1992 vs. 1996, Public School Students, Grade 8 
In Colorado from 1992 to 1996, the percentage of both males and 
females who attained the Proficient level did not change significantly. 

1990 vs. 1996, Public School Students, Grade 8 
From 1990 to 1996, the percentage of both males and females who 
attained the Proficient level increased. 
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TABLE 4.1 B - GRADE 8 


Percentage of Public School Students Attaining Mathematics 


State Assessment 


Achievement Levels by Gender 



Advanced 



At or Above 
Proficient 



At or Above 
Basic 



Below Basic 



Male 

1990 


Colorado 


2| 


:o.5) 


18 ( 


(1.1) 


59 I 


(1.6) 


41 ( 


(1.6) 




West 


3| 


:i.o) 


16 1 


(2.8) 


51 ( 


(3.3) 


49 1 


(3.3) 




Nation 


2| 


:o.5) 


17 ( 


(1.5) 


51 ( 


(2.0) 


49 1 


(2.0) 


1992 


Colorado 


2 1 


(0.5) 


23 1 


(1.4)« 


66 1 


(1.7)- 


34 ( 


(1.7)« 




West 


3( 


(1.2) 


20 1 


( 2.4) ; 


55 1 


(3.4) 


45 1 


(3.4) 




Nation 


3( 


(0.5) 


20 1 


(1.3) 


55 1 


(1.5) 


45 1 


(1.5) 


1996 


Colorado 


4( 


(0.7) 


28 1 


(1.7)« 


69 1 


( 1.9)- 


31 1 


(1.9)« 




West 


3( 


(0.9) 


21 ( 


(2:3) 


57 1 


(2.8) 


43 j 


(2.8) 




Nation 


4( 


(0.7) 


24 ( 


(1-6)- 


60 1 


(1.9)» 


40 1 


(1.9)« 


Female 

1990 


Colorado 


1 ( 


(0.5) 


16 ( 


(1.4) 


56 1 


(1.9) 


44 1 


(1.9) 




West 


2 1 


(0.9) 


14 ( 


(2.1) 


49 1 


(3.6) 


51 ( 


(3.6) 




Nation 


2 1 


(0.5) 


14 ( 


(1.2) 


51 ( 


(1.7) 


49 ( 


(1.7) 


1992 


Colorado 


2 1 


(0.7) 


20 1 


(1.5) 


62 1 


(1.9) 


38 ( 


(1.9) 




West 


4 ( 


(1.2) 


21 ( 


(2.4) 


58 1 


(2.7) 


42 ( 


(2.7) 




Nation 


3 1 


(0.5) 


20 1 


(1-3)- 


56 1 


(1.5) 


44 ( 


(1.5) 


1996 


Colorado 


2 1 


(0.5) 


23 1 


(1.7)- 


64 1 


(1.8)« 


38 ( 


(1.8)« 




West 


3( 


(1.0) 


20 1 


(2.4) 


59 1 


(3.0) 


41 ( 


(3.0) 




Nation 


3( 


(0.6) 


21 ( 


(1.4)- 


61 ( 


(1.5)«> 


39 1 


(1.5)«< 



The standard enors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for t^ entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
» («) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1990 
at atout the 95 percent confidence level. If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990, 1992, 
and 1996 Mathematics Assessments. 
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Race/Ethnicity 

Table 4.2A provides the percentages of fourth-grade public school students at or 
above each of the three mathematics achievement levels and also the percentage below 
the Basic level for White, Black, Hispanic, Asian/Pacific Islander, and American Indian 
students. 



1996, Public School Students, Grade 4 
The percentage of White students in Colorado who attained the 
Proficient level was larger than that of Black, Hispanic, and American 
Indian students but was not significantly different from that of 
Asian/Pacific Islander students. 

1992 vs. 1996, Public School Students, Grade 4 
From 1992 to 1996, there was no significant change in the percentage 
of White, Black, Hispanic, Asian/Pacific Islander, or American Indian 
students who attained the Proficient level in Colorado. 



Table 4.2B provides the percentages of eighth-grade public school students at or 
above each of the three mathematics achievement levels and the percentage below the 
Basic level for White, Black, Hispanic, and Asian/Pacific Islander students in Colorado, 
the West region, and the nation.'*^ 

1996, Public School Students, Grade 8 
The percentage of White students in Colorado who attained the 
Proficient level was larger than that of Black and Hispanic students but 
was not significantly different from that of Asian/Pacific Islander 
students. 



1992 vs. 1996, Public School Students, Grade 8 
From 1992 to 1996, there was no significant change in the percentage 
of White, Black, or Hispanic students who attained the Proficient level 
in Colorado. 

1990 vs. 1996, Public School Students, Grade 8 
From 1990 to 1996, there was an increase in the percentage of White 
and Hispanic students who attained the Proficient level in Colorado. 



42 

Results arc rcported for racial/ethnic subgroups meeting established sample size rcquircments (see Appendix A). 

43 . 

The 1996 national and regional results for eighth-grade Asian/Pacific Islander students are not included in this report. 
Following a thorough investigation into the quality and credibility of these results, NCES decided to omit these results 
from the body of the report and to include the national results in an appendix. (See Appendix F for further discussion.) 
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TABLE 4.2A - GRADE 4 


Percentage of Public School Students Attaining Mathematics 
Achievement Levels by Race/Ethnicity 


state Assessment 



Advanced 



At or Above 
Proficient 



At or Above 
Basic 



Below Basic 



White 












1992 


Colorado 


2 ( 0.6) 


22 ( 1.3) 


70 ( 1.5) 


30 ( 1.5) 




West 


2 ( 0.8) 


21 (3.1) 


69 ( 2.8) 


31 ( 2.8) 




Nation 


2 ( 0.4) 


22 ( 1.S) 


69 ( 1.4) 


31 (1.4) 


1996 


Colorado 


2 ( 0.5) 


28 ( 1.S) 


78 ( 1.4)> 


24( 1.4)< 




West 


3 ( 0.7) 


22 ( 2.3) 


68 ( 3.5) 


32 ( 3.5) 




Nation 


3 ( 0.5) 


28 ( 1.3) 


74 ( 1.6) 


26 ( 1.6) 


Black 












1992 


Colorado 


0 (*•**) 


3(1.4) 


32 ( 4.6) 


68 ( 4.6) 




West 


0 (****) 


2 ( 1.4) 


21 ( 5.6) 


79 ( 5.6) 




Nation 


0 (****) 


2 ( 0.7) 


22 ( 1.9) 


78 ( 1.9) 


1996 


Colorado 


0 (****) 


4 ( 2.8) 


26 ( 6.9) 


74 ( 6.9) 




West 


0 (****) 


4(2.1) 


30 ( 9.3) 


70 ( 9.3) 




Nation 


0(0.1) 


5 ( 1.5) 


32 ( 3.4) 


68 ( 3.4) 


Hispanic 










1992 


Colorado 


0 (****) 


6(1.5) 


42 ( 2.4) 


58 ( 2.4) 




West 


0 (****) 


5 ( 1.5) 


33 ( 3.1) 


67 ( 3.1) 




Nation 


0 (****) 


5 ( 1.0) 


33 ( 2.3) 


67 ( 2.3) 


1996 


Colorado 


0 (****) 


8(1.3) 


46 ( 2.7) 


54 ( 2.7) 




West 


0 (****) 


8 ( 1.5) 


38 ( 4.2) 


62 ( 4.2) 




Nation 


0 (••**) 


7 ( 1.0) 


40 ( 2.6) 


60 ( 2.6) 


Aslan/Pacific Islander 










1992 


Colorado 


0 (****) 


23 ( 5.9) 


63 ( 6.9) 


37 ( 6.9) 




West 


5 ( 2.5) 


30 ( 5.5) 


74 ( 4.5) 


26 ( 4.5) 




Nation 


4 ( 2.0) 


30 ( 4.9) 


75 ( 3.5) 


25 ( 3.5) 


1996 


Colorado 


3 ( 2.0) 


20 ( 5.3) 


68 ( 5.5) 


32 ( 5.5) 




West 


5 ( 3.2) 


20 ( 8.8) 


66 ( 6.9) 


34 ( 6.9) 




Nation 


5 ( 2.0) 


24 ( 6.0) 


72 ( 5.5) 


28 ( 5.5) 


American Indian 










1992 


Colorado 


1 (****) 


10 ( 4.7) 


50 ( 7.3) 


50 ( 7.3) 




West 




**• 


*** 






Nation 


2(1.0) 


10 ( 3.8) 


42 ( 5.3) 


58 ( 5.3) 


1996 


Colorado 


0 (****) 


12 ( 4.0) 


58 ( 7.0) 


42 ( 7.0) 




West 


1 rn 


9 ( 3.5) 


54(6.6) 


46 ( 8.8) 




Nation 


1 rn 


8 ( 2.5) 


52(6.1) 


46 ( 6.1) 



Results are reported for racial/ethnic subgroups meeting established sample size requirements (see Appendix A). The 
standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students was significantly higher Oower) than the value for 1992 
at about the 95 percent confidence level. *** Sample size is insufficient to permit a reliable estimate. ♦*** Standard 
error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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TABLE 4.2B - GRADE 8 


Percentage of Public School Students Attaining Mathematics 
Achievement Levels by Race/Ethnicity 


State Assessment 



White 


1990 


Colorado 

West 

Nation 


1992 


Colorado 

West 

Nation 


1998 


Colorado 

West 

Nation 


Black 


1990 


Colorado 

West 

Nation 


1992 


Colorado 

West 

Nation 


1996 


Colorado 

West 

Nation 


Hispanic 


1990 


Colorado 

West 

Nation 


1992 


Colorado 

West 

Nation 


1998 


Colorado 

West 

Nation 


Asian/PacifIc Islander 


1990 


Colorado 


1992 


Colorado 


1998 


Colorado 



Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below Basic 



2 ( 0.4) 

3 ( 0.8) 
3 ( 0,5) 

3 ( 0.6) 
4( 1.2) 

4 ( 0.5) 
4 ( 0.6) 

4 ( 0.9) 

5 ( 0,8) 

0 (•“•) 



0 (•*’ 
0 (“’ 
0 (“’ 
0 (**' 
0 (*•' 
0 (*•’ 
0 
0 



0 (“••) 
1 ( 0,3) 
0 ( 0 . 2 ) 

0 (••••) 
0 (••••) 

0 ( 0.3) 

1 ( 0.5) 
1 (••••) 
1 (••••) 

7 ( 4.0) 



21 


(1,2) 


66 


(1.4) 


34 


( 1.4) 


19 


(3,2) 


59 


(3.4) 


41 


(3.4) 


19 


( 1.4) 


60 


(1,8) 


40 


( 1.8) 


26 


( 1.4) 


72 


( 1.4)» 


28 


( 1.4)- 


27 


(2.4) 


68 


(3.4) 


32 


(3,4) 


26 


(1,3)» 


68 


( 1.4)« 


32 


(1.4)- 


31 


(1.4)» 


76 


( 1.2)» 


24 


( 1.2)- 


29 


(2,6) 


73 


( 2,2)« 


27 


( 2,2). 


30 


(1,5)« 


73 


( 1.5)» 


27 


(1.5)- 


1 


(*..*) 


20 


(5,5) 


80 


(5,5) 


8 


(2.7) 


33 


(9,9) 


67 


(9,9) 


5 


(1.1) 


22 


(2,5) 


78 


(2,5) 


5 


(2,9) 


26 


(6,2) 


74 


(6,2) 


1 


(0,8) 


22 


(5,5) 


78 


(5,5) 


CM 


(0,7) 


20 


(2.0) 


80 


(2,0) 


8 1 


(3,6) 


40 


(4,8) 


60 


(4,8) 


3 1 


(1.0) 


31 


(4,4) 


69 


(4.4) 


4 1 


(0.9) 


27 


( 2,9) 


73 


(2,9) 


4 1 


(1.0) 


32 


(2,6) 


68 


(2,6) 


5 1 


(2.0) 


31 


(3,8) 


69 


(3,8) 


5 1 


(1,5) 


31 


(3,2) 


69 


(3,2) 


71 


(1.1) 


41 


(2.5) 


59 


(2.5) 


61 


(0.9) 


34 


(2,5) 


66 


(2,5) 


61 


(0.8) 


32 


(2.1) 


66 1 


(2,1) 


101 


( 1.5)» 


43 


(3.1) 


57 1 


(3,1) 


71 


(1,9) 


36 


(2.7) 


64 1 


(2,7) 


8 1 

*** 1 


(1.6) 

f** 


37 


(2.5) 

*\ 


63 1 
••• 1 


(2,5) 


•••I 

37 1 


(••■•) 

(8.6) 


76 


\ • } 

(••.•) 

(9.9) 


... ^ 
24 1 


1 . ) 

(••.*) 

(9.9) 



Results are reported for racial/ethnic subgroups meeting established sample size requirements (see Appendix A), The 
standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
» («) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1990 
at about the 95 percent confidence level. If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. *** Sample size is 
insufficient to permit a reliable estimate. *’?'** Standard error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990, 1992, 
and 1996 Mathematics Assessments. 
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Students’ Reports of Parents’ Highest Education Level 

Table 4.3A shows the mathematics achievement level results for fourth-grade 
public school students who reported that neither parent graduated from high school, at 
least one parent graduated from high school, at least one parent had some education after 
high school, at least one parent graduated from college, or that they did not know their 
parents’ highest education level. It should be noted that 35 percent of fourth graders 
in Colorado reported that they did not know the education level of either of their parents. 

1996y Public School Students, Grade 4 
The percentage of Colorado students who reported that neither parent 
graduated from high school who attained the Proficient level did not 
differ significantly from that of students who reported that at least one 
parent graduated from high school but was smaller than that of students 
who reported that at least one parent had some education after high 
school or at least one parent graduated from college. 

1992 vs. 1996, Public School Students, Grade 4 
The percentage of students in Colorado who reported that neither parent 
graduated from high school, at least one parent graduated from high 
school, at least one parent had some education after high school, or at 
least one parent graduated from college who attained the Proficient level 
did not change significantly between 1992 and 1996. 
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Percentage of Public School Students Attaining Mathematics 
Achievement Levels by Students* Reports of Parents’ Highest 
Education Level 


State Assessment 



Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below Basic 



Did not finish high school 










1992 Colorado 


0 (****) 


5 ( 2.0) 


35 ( 4.6) 


65 ( 4.6) 


West 


0 (***•) 


5 ( 2.6) 


37(10.5) 


63 (10.5) 


Nation 


0 (**~) 


5(1.9) 


36 ( 5.4) 


62 ( 5.4) 


1996 Colorado 


or**) 


11 (3.9) 


45(6.1) 


55(6.1) 


West 


••• 


**• (**.*) 


••• I** 


**• (•*.•) 


Nation 


0 (••••) 


5(1.6) 


36 ( 4.4) 


64 ( 4.4) 


Graduated from high school 










1992 Colorado 


0 (••**) 


9 ( 2.1) 


52 ( 3.5) 


48 ( 3.5) 


West 


0 (****) 


13(4.5) 


56 ( 5.6) 


42 ( 5.6) 


Nation 


0 (*•**) 


12 ( 1.9) 


52 ( 2.9) 


48 ( 2.9) 


1998 Colorado 


1 r-) 


12 ( 1.9) 


56 ( 3.6) 


44 ( 3.6) 


West 


1 rn 


16(3.9) 


56 ( 6.6) 


44 ( 6.6) 


Nation 


1 rn 


15(2.0) 


56 ( 3.0) 


42 ( 3.0) 


Some education after H8 










1692 Colorado 


2(1.3) 


22 ( 3.4) 


73 ( 2.5) 


27 ( 2.5) 


West 


1 rn 


19 ( 3.5) 


61 (4.7) 


39 ( 4.7) 


Nation 


2 ( 0.6) 


21 ( 2.5) 


67 ( 3.0) 


33 ( 3.0) 


1996 Colorado 


2(1.0) 


27 ( 3.1) 


60 ( 3.9) 


20 ( 3.9) 


West 


1 rn 


16 ( 4.7) 


74 ( 6.6) 


26 ( 6.6) 


Nation 


2(1.1) 


27 ( 3.1) 


76 ( 3.0) 


24 ( 3.0) 


Graduated from college 










1992 Colorado 


3 ( 0.6) 


25 ( 1.5) 


71 (1.9) 


29 ( 1.9) 


West 


3(1.4) 


23 ( 4.0) 


65 ( 2.7) 


35 ( 2.7) 


Nation 


3 ( 0.6) 


25 ( 2.0) 


66(1.5) 


34(1.5) 


1996 Colorado 


3 ( 0.7) 


32(1.6) 


76 ( 1.9) 


24 ( 1.9) 


West 


4(1.2) 


23 ( 4.5) 


66 ( 3.6) 


34 ( 3.6) 


Nation 


4 ( 0.7) 


27 ( 1.9) 


70(1.9) 


30(1.9) 


1 don't know 










1992 Colorado 


0 ( 0.2) 


12(1.4) 


52(1.6) 


48 ( 1.6) 


West 


1 ( 0.5) 


12(2.7) 


51 ( 3.0) 


49 ( 3.0) 


Nation 


1 ( 0.3) 


12(1.1) 


50(1.5) 


50(1.5) 


1996 Colorado 


1 ( 0.5) 


13(1.5) 


57 ( 2.4) 


43 ( 2.4) 


West 


1 (****) 


11 (1.6) 


47 ( 4.5) 


53 ( 4.5) 


Nation 


1 ( 0.4) 


14(1.2) 


55 (2.1) 


45(2.1) 



Results are reported for parental education subgroups meeting established sample size requirements (see Appendix A). 
The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estin^es, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 
at about the 95 percent confidence level. *** Sample size is insufficient to permit a reliable estimate. **** Standard 
error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Table 4.3B presents achievement level results for eighth-grade students by 
students’ reports of highest level of parental education. It should be noted that 
10 percent of eighth graders in Colorado reported that they did not know the education 
level of either of their parents. 

1996y Public School StudentSy Grade 8 
In Colorado, the percentage of students who reported that neither parent 
graduated from high school who attained the Proficient level was 
smaller than that of students who reported that at least one parent 
graduated from high school, at least one parent had some education after 
high school, or at least one parent graduated from college. 

1992 vs. 1996y Public School StudentSy Grade 8 
The percentage of students in Colorado who reported that neither parent 
graduated from high school, at least one parent graduated from high 
school, at least one parent had some education after high school, or at 
least one parent graduated from college who attained the Proficient level 
did not change significantly between 1992 and 1996. 

1990 vs. 1996y Public School StudentSy Grade 8 
A greater percentage of students in Colorado who reported that at least 
one parent graduated from college attained the Proficient level in 1996 
than in 1990. The percentage of students in Colorado who reported that 
neither parent graduated from high school, at least one parent graduated 
from high school, or at least one parent had some education after high 
school who attained the Proficient level did not change significantly 
between 1990 and 1996. 
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TABLE 4.3B - GRADE 8 
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Percentage of Public School Students Attaining Mathematics 
Achievement Levels by Students* Reports of Parents* Highest 
Education Level 


1998 
State Ass 


J 

essmetil 


t 



Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below Basic 



Did not finish high schooi 
1990 Colorado 


0 (****) 


3(1.4) 


27 I 


[4.6) 


73 ( 4.6) 


West 


0 (****) 


5 ( 2.9) 


30 I 


[5.7) 


70 ( 5.7) 


Nation 


0 (****) 


3(1.1) 


24 I 


[3.5) 


76 ( 3.5) 


1992 Colorado 


0 (****) 


5(1.6) 


36 ( 


:4.6) 


64 ( 4.6) 


West 


0 (****) 


5 ( 2.8) 


36 ( 


:3.9) 


64 ( 3.9) 


Nation 


1 (****) 


6(1.7) 


34( 


: 3.2) 


66 ( 3.2) 


1996 Colorado 


0 (****) 


4(2.1) 


27 ( 


:s.6) 


73 ( 5.6) 


West 


0 (****) 


1 1 ( 3.2) 


47 I 


:4.8) 


53 ( 4.8) 


Nation 


1 rn 


8(2.1) 


44 ( 


: 2.7)« 


56 ( 2.7)« 


Graduated from high school 






1990 Colorado 


1 r***) 


8(1.8) 


41 ( 


2.8) 


59 ( 2.8) 


West 


0 (****) 


6 ( 2.6) 


36 ( 


4.5) 


64 ( 4.5) 


Nation 


0 (****) 


8(1.3) 


41 ( 


2.0) 


59 ( 2.0) 


1992 Colorado 


1 ( 0.4) 


10 ( 1.6) 


50 ( 


2.8) 


50 ( 2.8) 


West 


1 ( 0.6) 


9 ( 2.4) 


41 ( 


3.8) 


59 ( 3.8) 


Nation 


1 ( 0.4) 


10(1.1) 


45 ( 


2.1) 


55(2.1) 


1996 Colorado 


1 (****) 


12 ( 1.6) 


54 ( 


2.6)» 


46 ( 2.6)« 


West 


1 rn 


9(1.8) 


45 ( 


3.4) 


55 ( 3.4) 


Nation 


1 ( 0.5) 


12 ( 1.3) 


50 ( 


2.1 )« 


50(2.1)« 


Some education after HS 






1990 Colorado 


1 ( 0.5) 


16 ( 1.9) 


64 ( 


2.0) 


36 ( 2.0) 


West 


4(1.8) 


15 ( 2.9) 


61 ( 


4.5) 


39 ( 4.5) 


Nation 


3 ( 0.9) 


15 ( 2.0) 


57 ( 


2.7) 


43 ( 2.7) 


1992 Colorado 


2 ( 0.7) 


22 ( 2.6) 


71 ( 


2.4) 


29 ( 2.4) 


West 


4(1.9) 


23 ( 3.1) 


64 ( 


3.5) 


36 ( 3.5) 


Nation 


3 ( 0.7) 


20 ( 1 .4) . 


60 ( 


1.8) 


40 ( 1 .8) 


1996 Colorado 


3 ( 0.9) 


26 ( 2.8) 


74 ( 


2.3)» 


26 ( 2.3)« 


West 


3(1.5) 


24 ( 2.9) 


70 ( 


3.9) 


30 ( 3.9) 


Nation 


4 ( 0.8) 


26 ( 2.0)» 


71 ( 


2.1)»> 


29(2.1)«< 


Graduated from coiiege 








1990 Colorado 


3 ( 0.7) 


25 ( 1.4) 


69 ( 


1.7) 


31 (1.7) 


West 


4(1.0) 


24 ( 3.6) 


62 ( 


3.0) 


38(3.0) 


Nation 


4 ( 0.8) 


25 ( 2.2) 


66 ( 


2.1) 


34 ( 2.1) 


1992 Colorado 


4 ( 0.8) 


32 ( 1.6)« 


75 ( 


1.4) 


25 ( 1 .4) 


West 


6(1.9) 


31 ( 3.3) 


71 ( 


2.9) 


29 ( 2.9) 


Nation 


5 ( 0.8) 


31 ( 1.9) 


70 ( 


1.5) 


30 ( 1.5) 


1996 Colorado 


5 ( 0.9) 


38 ( 2.0)» 


80 ( 


1.7)« 


20 ( 1.7)« 


West 


5(1.1) 


33 ( 3.2) 


71 ( 


2.7) 


29 ( 2.7) 


Nation 


7(1.2) 


34 ( 2.2) 


72 ( 


1.6) 


28 ( 1.6) 


i don’t know 








1990 Colorado 


0 (****) 


6 ( 2.0) 


38 ( 


4.0) 


62 ( 4.0) 


West 


0 (****) 


5 ( 2.8) 


34( 


5.9) 


66 ( 5.9) 


Nation 


0 (****) 


5(1.7) 


29 ( 


3.5) 


71 ( 3.5) 


1992 Colorado 


0 r***) 


6(1.9) 


41 ( 


4.2) 


59 ( 4.2) 


West 


0 (****) 


9 ( 2.4) 


36 ( 


3.6) 


64 ( 3.6) 


Nation 


0 (****) 


9(1.4) 


38 ( 


2.5) 


62 ( 2.5) 


1996 Colorado 


0 (****) 


9(3.1) 


43 ( 


4.3) 


57 ( 4.3) 


West 


0 (****) 


10(2.8) 


38 ( 


3.2) 


62 ( 3.2) 


Nation 


1 ( 0.3) 


10 (1.5) 


41 ( 


2.2) 


59 ( 2.2) 



Results are reported for parental education subgroups meeting established sample size requirements (see Appendix A). 
The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estin^s, one must use the standard error of the difference (see Appendix A for details). If the notation 
» («) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1990 
at about the 95 percent confidence level. If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. **** Standard error 
estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of 
and 1996 Mathematics Assessments. 
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Title I Participation 

Table 4.4 presents the percentage of fourth and eighth graders at or above each 
of the mathematics, achievement levels as . well as the percentage of students below Basic 
by Title I participation. (Results based on participation in Title I programs are not 
available for previous state-level mathematics assessments.) 

1996, Public School Students, Grade 4 
In Colorado T percent of the students receiving Title I services 
performed at or above the Proficient level. About one quarter of the 
students who did not receive Title I services attained the Proficient level 
(24 percent). 

1996, Public School Students, Grade 8 
About one quarter of the students who did not receive Title I services 
attained the Proficient level (26 percent). 
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TABLE 4.4 — GRADES 4 AND 8 


Percentage of Public School Students Attaining Mathematics 
Achievement Levels by Title I Participation 


State Assessment 



Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below Basic 



GRADE 4 
Participated 
1996 Colorado 


0 (****) 


1 ( 0.9) 


21 1 


[5.2) 


79 ( 


(5.2) 


West 


0 (****) 


4(1.8) 


33 4 


[4.9) 


67 ( 


(4.9) 


Nation 


0 (****) 


3 ( 0.9) 


31 1 


(2.7) 


69 1 


( 2.7) 


Did not participate 
1996 Colorado 


2 ( 0.3) 


24 ( 1.4) 


70 1 


(1.6) 


30 1 


(1.6) 


West 


3 ( 0.7) 


21 ( 2.2) 


67 1 


(3.1) 


33 ( 


(3.1) 


Nation 


3 ( 0.4) 


25 ( 1 .3) 


72 1 


(1.6) 


28 1 


(1.6) 


GRADE a 
Did not participate 
1996 Colorado 


3 ( 0.5) 


26 ( 1.3) 


68 1 


(1.2) 


32 1 


( 1.2) 


West 


3 ( 0.7) 


23 ( 2.0) 


63 1 


(1.8) 


37 I 


(1.8) 


Nation 


4 ( 0.7) 


25 ( 1.4) 


66 1 


(1.4) 


34 1 


(1.4) 



Results are reported for students participating in Title I programs .only if established sample size requirements are met 
(see Appendix A). The standard errors of the statistics appear in parentheses. It can be said with about 95 percent 
confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors of the 
estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see Appendix 
A for details). *** Sample size is insufficient to permit a reliable estimate. •*** Standard error estimates cannot be 
accurately determined. 

SOURCE:. National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 
Mathematics Assessment. 
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Free/Reduced-Price Lunch Program Eligibility 

Table 4.5 shows 1996 mathematics achievement level results for fourth and eighth 
graders based on their eligibility for the federally funded free/reduced-price lunch 
component of the National School Lunch Program. (Similar results are not available for 
previous NAEP mathematics assessments.) 

1996, Public School Students, Grade 4 
The percentage of students in Colorado eligible for free or reduced-price 
lunch who performed at or above the Proficient level (9 percent) was 
not significantly different from that of students nationwide (8 percent). 

The percentage of students in Colorado who were not eligible for this 
service who attained this level (28 percent) was not significantly 
different from the figure for the nation (25 percent). In Colorado, the 
percentage of students eligible for free or reduced-price lunch who 
attained the Proficient level was smaller than that of students who were 
not. 



1996, Public School Students, Grade 8 
The percentage of Colorado students who were eligible for free or 
reduced-price lunch who attained the Proficient level (11 percent) was 
not significantly different from the percentage of students nationwide 
(8 percent). The percentage of students in Colorado who were not 
eligible for this service who attained this level (31 percent) was not 
significantly different from the corresponding national figure 
(29 percent). In Colorado, the percentage of students eligible for free 
or reduced-price lunch who performed at or above the Proficient level 
was smaller than that of students who were not eligible for this service. 
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TABLE 4.5 - GRADES 4 AND 8 


=4 


Percentage of Public School Students Attaining Mathematics 
Achievement Levels by Free/Reduced-Price Lunch Eligibility 


state Assessment 



Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below Basic 



GRADE 4 
Eligible 














1996 Colorado 


0 ( 0.2) 


9(1.6) 


451 


[3.0) 


55 { 


(3.0) 


West 


0 (••**) 


7 ( 2.3) 


391 


[4.4) 


61 { 


(4.4) 


Nation 


0 ( 0.3) 


8( 1.2) 


41 { 


[2.6) 


591 


(2.6) 


Not eligible 














1998 Colorado 


2 ( 0.5) 


28 ( 1.7) 


77 1 


:i.5) 


231 


(1.5) 


West 


3 ( 0.9) 


21 ( 2.2) 


681 


[3.6) 


321 


(3.6) 


Nation 


3 ( 0.6) 


25 ( 1.4) 


731 


:i.8) 


27 1 


(1.8) 


Information not availablo 














1998 Colorado 


1 ( 0.8) 


21 ( 5.2) 


71 ( 


(4.6) 


29 1 


(4.6) 


West 


4 


24 (13.4) 


631 


(9.4) 


37 ( 


(9.4) 


Nation 
GRADE B 


3(1.6) 


28 ( 5.4) 


72 ( 


(5.6) 


28 1 


(5.6) 


Eligible 














1998 Colorado 


1 ( 0.6) 


11 (1.5) 


46 1 


(2.4) 


54( 


( 2.4) . 


West 


0 (****) 


7( 1.5) 


40 1 


(3.8) 


601 


(3.8) 


Nation 


1 ( 0.3) 


8(1.1) 


39 1 


(1.8) 


61 ( 


(1.8) 


Not eligible 














1996 Colorado 


4 ( 0.7) 


31 (1.6) 


75 1 


(1.5) 


25 1 


(1.5) 


West 


4 ( 0.9) 


26 ( 2.3) 


67 1 


(2.5) 


33 1 


(2.5) 


Nation 


5 ( 0.9) 


29 ( 1.7) 


71 1 


(1.7) 


29 1 


(1.7) 


Information not available 














1688 Colorado 


3(1.2) 


22 ( 3.8) 


60 1 


(6.2) 


40i 


(6.2) 


West 


4 ( 2.0) 


27 ( 6.8) 


66 


(6.2) 


34 1 


(6.2) 


Nation 


5(1.5) 


29 ( 4.6) 


69 


(4.2) 


31 1 


(4.2) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). **** Standard 
error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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Type of Location 

Table 4.6A presents achievement level results for fourth-grade students attending 
public schools in central cities, urban fringes/large towns, and rural areas/small towns, 

1996, Public School Students, Grade 4 
The percentage of Colorado students attending schools in central cities 
who attained the Proficient level was not significantly different from that 
of students in urban fringes/large towns or rural areas/small towns. 

1992 vs. 1996, Public School Students, Grade 4 
From 1992 to 1996, there was no significant change in the percentage 
of students attending schools in any of the three types of location in 
Colorado who attiiined the Proficient level. 
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TABLE 4.6A - GRADE 4 


Percentage of Public School Students Attaining Mathematics 
Achievement Levels by Type of Location 



Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below Basic 



Central city 


















1992 Colorado 


2 


(0.6) 


16 I 


( 1.8) 


55 ( 


(2.6) 


45 1 


(2.8) 


Nation 


1 I 


(0.3) 


13 ( 


( 1.4) 


46 1 


(2.3) 


52 1 


(2.3) 


1996 Colorado 


2 


(0.6) 


21 ( 


(2.2) 


62 1 


(3.7) 


36i 


(3.7) 


Nation 


2 I 


(0.6) 


15 ( 


( 1.4) 


51 1 


(3.7) 


49 1 


(3.7) 


Urban frInge/Large town 


















1992 Colorado 


2 I 


(0.5) 


19 ( 


( 1.7) 


64 1 


(2.1) 


38 1 


(2.1) 


Nation 


3i 


(0.6) 


23 1 


(2.1) 


66 1 


(2.1) 


344 


(2.1) 


1996 Colorado 


2 I 


(0.5) 


25 1 


(2.2) 


721 


(2.7) 


26 1 


(2.7) 


Nation 


3i 


(0.6) 


24 ( 


(1.6) 


69 4 


(2.3) 


31 4 


(2.3) 


Rural/Small town 


















1992 Colorado 


1 ( 


(0.6) 


17 ( 


(2.5) 


62 4 


(2.6) 


36 4 


(2.6) 


Nation 


1 I 


(0.3) 


15 ( 


(2.1) 


56 4 


(2.6) 


44 4 


(2.8) 


1996 Colorado 


1 ( 


(0.5) 


20 { 


(2.6) 


67 4 


(3.5) 


33 4 


(3.5) 


Nation 


1 ( 


(0.3) 


19 1 


(2.2) 


62 4 


(2.8) 


38 4 


(2.8) 



Results are reported for type of location subgroups meeting established sample size requirements (see Appendix A). The 
standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estiii^es, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 
at about the 95 percent confidence level. Characteristics of the school sample do not permit reliable regional results for 
type of location. **** Standard error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 




o 

ERIC 



90 



THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



Colorado 



Table 4.6B presents achievement level results for eighth-grade students attending 
public schools in central cities, urban fringes/large towns, and rural areas/small towns. 

1996, Public School Students, Grade 8 
In Colorado, the percentage of students attending schools in central 
cities who attained the Proficient level was not significantly different 
from that of students in urban fringes/large towns or rural areas/small 
towns. 

1992 vs. 1996, Public School Students, Grade 8 
From 1992 to 1996, there was no significant change in the percentage 
of students attending schools in any of the three types of location in 
Colorado who attained the Proficient level. 



TABLE 4.6B - GRADE 8 

Percentage of Public School Students Attaining Mathematics 
Achievement Levels by Type of Location 



Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below Basic 



Central city 
1992 Colorado 


3 ( 


[ 0 . 7 ) 


22 1 


[ 1 . 7 ) 


60 1 


[ 2 . 4 ) 


40 ( 


2 . 4 ) 


Nation 


2 1 


( 0 . 5 ) 


15 1 


[ 1 . 8 ) 


46 1 


[ 3 . 5 ) 


54 ( 


3 . 5 ) 


1996 Colorado 


31 


( 0 . 8 ) 


24 1 


[ 2 . 2 ) 


62 1 


[ 2 . 5 ) 


38 ( 


2 . 5 ) 


Nation 


3 ( 


[ 0 . 7 ) 


16 1 


[ 1 . 7 ) 


47 ( 


[ 2 . 8 ) 


53 ( 


2 . 8 ) 


Urban frInge/Large town 
1992 Coiorado 


2 | 


[ 0 . 6 ) 


22 1 


[ 1 . 8 ) 


66 1 


[ 2 . 3 ) 


34 ( 


2 . 3 ) 


Nation 


5 ( 


[ 0 . 8 ) 


25 1 


[ 2 . 0 ) 


641 


[ 2 . 3 ) 


36 ( 


2 . 3 ) 


1996 Colorado 


4 ( 


[ 1 . 0 ) 


28 1 


[ 2 . 2 ) 


70 1 


[ 2 . 2 ) 


30 ( 


2 . 2 ) 


Nation 


5 ( 


[ 1 . 4 ) 


26 1 


[ 3 . 0 ) 


64 | 


[ 2 . 8 ) 


36 ( 


. 2 . 6 ) 


Rural/Small town 
1992 Colorado 


1 ( 


[ 0 . 8 ) 


21 ( 


[ 3 . 4 ) 


65 1 


[ 3 . 2 ) 


35 ( 


3 . 2 ) 


Nation 


1 ( 


[ 0 . 5 ) 


17 ( 


[ 1 . 5 ) 


55 1 


[ 2 . 2 ) 


45 ( 


2 . 2 ) ^ 


1996 Colorado 


1 ( 


[ 0 . 8 ) 


22 1 


[ 2 . 7 ) 


66 1 


[ 3 . 1 ) 


32 ( 


3 . 1 ) 


Nation 


3 | 


[ 0 . 6 ) 


25 1 


[ 1 . 7 )> 


69 1 


[ 2 . 6 )> 


31 ( 


2 . 6 )< 
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Results are reported for type of location subgroups meeting established sample size requirements (see Appendix A). The 
standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 
at about the 95 percent confidence level. Characteristics of the school sample do not permit reliable regional results for 
type of location. *** Sample size is insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Type of School 

Table 4.7 provides the percentage of fourth-grade students at or above each 
achievement level for the public, nonpublic, and combined populations. Trend results 
are not presented for the nonpublic and combined populations because the nonpublic 
schools were not included in previous NAEP state mathematics assessments. 

1996, Nonpublic School Students, Grade 4 
The percentage of nonpublic school students who performed at or above 
the Proficient level in Colorado (19 percent) was smaller than that of 
nonpublic school students nationwide (33 percent). 

1996, Public vs. Nonpublic School Students, Grade 4 
In Colorado, the percentage of public school students who attained the 
Proficient level (22 percent) was not significantly different from the 
corresponding percentage of nonpublic school students (19 percent). 

1996, Public and Nonpublic School Students Combined, Grade 4 
In Colorado, 22 percent of public and nonpublic school students 
combined performed at or above the Proficient level. This percentage 
did not differ significantly from that of students across the nation 
(21 percent). 
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TABLE 4.7 - GRADE 4 


CARD 

1896 


y 




Percentage of Students Attaining Mathematics Achievement 


State Assessment 


Levels by Type of School 



Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Beiow Basic 



Public 










1996 Colorado 


2 ( 0.3) 


22 ( 1.3) 


67 ( 1.6) 


33 ( 1.6) 


West 


2 ( 0.5) 


16 ( 1.B) 


57 ( 3.0) 


43 ( 3.0) 


Nation 


2 ( 0.3) 


20 ( 1.0) 


62 ( 1.4) 


38 ( 1.4) 


Nonpublic 










1996 Colorado 


0 (“**) 


19 ( 5.5) 


68 ( 9.8) 


34 ( 9.8) 


West 


e ( 4.0) 


35 (10.1) 


76(8.1) 


24(8.1) 


Nation 


4(1.2) 


33 ( 2.2) 


80 ( 2.2) 


20 ( 2.2) 


Combined 










1996 Colorado 


2 ( 0.3) 


22 (1.2) 


87 ( 1.8) 


33 ( 1.8) 


West 


2 ( 0.5) 


18(1.7) 


58 ( 2.8) 


42 ( 2.8) 


Nation 


2 ( 0.3) 


21 ( 0.9) 


64 ( 1.2) 


36(1.2) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appetidix A for details). •••• Standard 
enor estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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PART THREE 



Finding a Context for Understanding 
Students’ Mathematics Performance in Pubiic 
Schools 

he mathematics performance of public school students in Colorado often can 
be better understood when viewed in the context of the environment in which the 
students are learning. This educational environment is largely determined by school 
characteristics, by characteristics of mathematics instruction in the school, by home 
support for academics and other home influences, and by the students’ own views about 
mathematics. Information about this environment is gathered by means of the 
questionnaires administered to principals, teachers, and students. 

Because NAEP is administered to a sample of students that is representative of the 
fourth- and eighth-grade student populations in the schools of Colorado, NAEP results 
provide a broad view of the educational practices in Colorado, which is useful for 
improving instruction and setting policy. However, despite the richness of the NAEP 
results, it is very important to note that NAEP data cannot establish a cause-and-effect 
relationship between educational environment and student scores on the NAEP 
mathematics assessment. 

The variables contained in Part Three are from the school characteristics and 
policies questionnaire, teacher questionnaires, and student background questions. These 
questionnaires are sometimes refined by revising or reformatting questions between 
assessments. Additional questions are sometimes added to questionnaires to track 
emerging trends in education. These revisions and additions may make comparisons 
with results from previous years unwise or impossible. When appropriate, trends across 
assessments are presented; otherwise, only 1996 results are discussed. 

Part Three consists of three chapters: Chapter 5 discusses school characteristics 
related to mathematics instruction;^ Chapter 6 describes classroom practices related to 
mathematics instruction, including calculator and computer use; and Chapter 7 covers 
some potential influences from the home and from the students’ own views about 
mathematics. 
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Information on teacher preparation is included in Appendix E of this report. 
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CHAPTER 5 



School Characteristics Reiated to 
Mathematics instruction 



School programs and conditions, instructional practices, and resource availability 
vary from state to state and even among schools within a locality. The information in 
this chapter is intended to give insight into those characteristics that are associated with 
students’ success in mathematics. 

The variables reported here reflect information from the questionnaires completed 
by principals and teachers of the public school students in the NAEP 1996 mathematics 
assessment. In all cases, analyses are done at the student level. School and 
teacher-reported results are given in terms of the percentage of students who attend 
schools or who have teachers reporting psuticular practices.'*^ 



In the school characteristics and policies questionnaire, principals were asked 
whether their school has identified mathematics as a priority in the last two years (i.e., 
whether mathematics receives special emphasis in school-wide goals and objectives, 
instruction, and workshops, etc.). Tables 5.1A and 5. IB present the public school 
principals’ reports. 

• The percentage of fourth-grade students in Colorado who attended 
schools that reported that mathematics was a priority (63 percent) was 
smaller than the national percentage (76 percent). 

® The percentage of Colorado eighth graders in schools that reported that 
mathematics was a priority (69 percent) was not significantly different 
from that of students nationwide (74 percent). 



Emphasis on Mathematics in the School 




45 

Appendix A provides more details on the units of analysis used to derive the results presented in this report. 
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TABLE 5.1 A - GRADE 4 



Public Schools’ Reports on Mathematics as a Priority 





Has your school Identified 
mathematics as a priority In the 
last two years? 


Colorado 


West 


Nation 


Percentage and Average Scale Score 









Yes 


63(4.2) 


73 ( 8.2) 


76 ( 3.9) 




223 ( 1.5) 


221 ( 2.0) 


222 ( 1 .2) 


No 


37 ( 4.2) 


27 ( 8.2) 


24 ( 3.9) 




230 ( 2.7) 


209 ( 5.2)1 


220 ( 3.1) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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TABLE 5.1 B - GRADE 8 



Public Schools’ Reports on Mathematics as a Priority 



Colorado 


West 


Nation 


Percentage and Average Scale Score 



Haa your school identified 
mathematics as a priority in the 
last two years? 



Yes 


69(4.1) 


81 (5.7) 


74 ( 3.3) 




276 ( 1 .4) 


269 ( 2.5) 


270 ( 1 .7) 


No 


31 (4.1) 


19(5.7) 


26 ( 3.3) 




274 ( 2.7) 


271 (5.2)! 


275 ( 2.3) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 

SOURCE; National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 
Mathematics Assessment. 
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Resource Availability to Teachers 

Resources available to teachers and schools vary. Past surveys have shown that 
teachers’ perceptions of the availability of resources (e.g., instructional materials, staff, 
and preparation or planning time) are variable across the country Previous NAEP 
assessments in several subject areas have also shown a positive relationship between 
teachers’ reports of resource availability and their students’ performance in most 
states.'*^ 

Availability of Instructional Materials 

Teachers often see the lack of resources as a key problem for mathematics 
instruction. In 1993 a national survey reported that the average school spent $100 per 
year on mathematics software, $1.00 per elementary school student on mathematics 
materials and manipulatives, and $0.40 per middle school student on mathematics 
materials.'** Teachers were asked to categorize how well their school systems provided 
them with the classroom instructional materials they needed. Table 5.2A shows the 
percentages of fourth-grade students whose teachers reported receiving varying levels 
of support from their public schools. 

• The average mathematics scale score of students in Colorado whose 
teachers reported receiving all the resources they needed (225) was not 
significantly different from that of students whose teachers received 
some or none of the resources they needed (225). The percentage of 
students whose teachers reported receiving all of the resources they 
needed in Colorado (14 percent) was not significantly different from 
that of students across the nation (12 percent). 



46 

National Center for Education Statistics. Schools and Staffing in the United States: A Statistical Profile, 1993-94. 
(Washington, DC: National Center for Education Statistics, 1996). 

Miller, K.E., J.E. Nelson, and M. Naifeh. Cross-State Data Compendium for the NAEP 1994 Grade 4 Reading 
Assessment. (Washington, DC: National Center for Education Statistics, 1995). 
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TABLE 5.2A - GRADE 4 


Public School Teachers’ Reports on Resource Availability 


State Assessment 



Colorado 


West 


Nation 


Percentage and Average Scale Score 



Which of the following statements Is true about 
how well your school system provides you with 
the Instructional materials and other resources 
you need to teach your class? 



1 get some or none of the resources 1 need. 1992 


34 ( 3.2) 
219(1.7) 


32 ( 4.7) 
212 ( 3.2) 


37 ( 3.5) 
214 ( 2.0) 


1996 


35 ( 3.5) 
225 ( 2.3) 


36 ( 3.6) 
222 ( 2.5) 


34 ( 2.5) 
221 ( 1 .5)> 


1 get most of the resources 1 need. 1 992 


55 ( 2.9) 
222 ( 1.6) 


58 ( 4.8) 
221 ( 2,1) 


52 ( 3.0) 
221 ( 1 .2) 


1996 


51 ( 3.1) 
227 ( 1.5)> 


56 ( 3,5) 
218 ( 3.1) 


55 ( 2.2) 
224 ( 1.5) 


1 get all the resources 1 need. 1992 


11 (2.1) 
226 ( 4.2) 


10 ( 2,3) 
226 ( 4.4)1 


11 (1,7) 
222 ( 2,7) 


1996 


14 (2.3) 
225 ( 3.9) 


8 ( 3.3) 
217 ( 2.4)! 


12 ( 1,8) 
224 ( 2.3) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret with caution 
■ — the nature of the sample does not allow accurate determination of the variability of this statistic, 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Eighth-grade mathematics teachers were also asked about the availability of 
resources. Based on the responses of public school teachers in Colorado, the results are 
shown in Table 5.2B. 

• The average scale score of Colorado students whose teachers reported 
receiving all the resources they needed (279) was not significantly 
different from that of students whose teachers received some or none 
of the resources they needed (275). The percentage of students whose 
teachers received all of the resources’ ‘ thSy needed in Colorado 
(14 percent) was not significantly different from that of students 
nationwide (20 percent). 
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TABLE 5.2B - GRADE 8 



Public School Teachers^ Reports on Resource Availability 



Which of the foiiowing statements is true about 
how weii your schooi system provides you with 
the instructionai materiais and other resources 
you need to teach your ciass? 


Colorado 


West 


Nation 


Percentage and Average Scale Score 




1 get some or none of the resources 1 need. 1990 


23 ( 3.2) 


23 ( 6.1) 


31 ( 4.2) 




262 ( 2.4) 


254 ( 4.6)1 


260 (3.1) 


1992 


36 ( 3.3)» 


35 ( 3.4) 


33 ( 1 .9) 




270(1.8) 


264 ( 2.7) 


262 ( 1 .5) 


1996 


26 ( 3.2) 


21 ( 4.0)< 


22 ( 2.7)< 




275 ( 2.6)» 


267 ( 3.3) 


265 ( 2.7) 


1 get most of the resources 1 need. 1990 


61 ( 3.6) 


62 ( 3.6) 


56 ( 4.0) 




269 ( 1.3) 


267 ( 4.2) 


265 ( 2.0) 


1992 


51 ( 3.0) 


52 (4.1) 


53 ( 2.5) 




275 ( 1.5)» 


269 ( 2.4) 


270 ( 1.1) 


1996 


56 ( 3.5) 


57 ( 4.6) 


58 ( 3.3) 




276 ( 1.7)« 


269 ( 3.5) 


272 ( 1.7)« 


1 get all the resources 1 need. 1 990 


15(2.4) 


15 ( 5.2) 


13 ( 2.4) 




266 ( 2.9) 


261 ( 5.1)! 


264 ( 3.7) 


1992 


13(2.1) 


12 ( 2.7) 


13 ( 2.3) 




271 ( 4.4) 


271 ( 5.0)1 


273 ( 3.3) 


1996 


14 ( 2.3) 


22 ( 6.0) 


20 ( 3.1) 




279 ( 2.8)» 


279 ( 6.3)1 


279 ( 2.9)« 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In con^aring two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation » («) appears, it signifies that the value for public school students 
was signific^tly higher (lower) than the value for 1990 at about the 95 percent confidence level; If the notation > (<) 
appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 at 
about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990, 1992, 
and 1996 Mathematics Assessments. 
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Availability of Curriculum Specialist in the School 

Teachers were asked if there was a curriculum specialist available to help or advise 
them in mathematics. Table 5.3A shows the public school fourth-grade teachers’ 
responses. 

o In Colorado, less than half of the students were taught by teachers who 
reported that there was a curriculum specialist available to help or advise 
in mathematics (44 percent). This figure was not significantly different 
from that of students across the nation (46 percent). 

• The percentage of Colorado students whose teachers reported having a 
curriculum specialist available in mathematics did not change 
significantly from 1992 (39 percent) to 1996 (44 percent). 
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TABLE 5.3A - GRADE 4 


Public School Teachers* Reports on Curriculum Specialists 



l3 there e curriculum specialist 


Colorado 


West 


Nation 


available to help or advise you In 
mathematics? 


Percontage and Average Scale Score 



Yes 


1992 


39 ( 4.0) 


52 ( 6.3) 


50 ( 3.3) 






221 ( 2.1) 


222 ( 2.3) 


210 ( 1.3) 




1996 


44 ( 3.7) 


40 ( 5.7) 


46(3.6): 






222 ( 1.8) 


217(2.7) 


. 221(2.1) 


No 


1992 


61 ( 4.0) 


48 ( 6.3) 


50 ( 3.3) 






221 ( 1.3) 


214(3.5) 


219(1.6) 




1996 


56 ( 3.7) 


52 ( 5.7) 


54 ( 3.6) 






229 ( 1.3)> 


221 ( 2.9) 


224 ( 1.4) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Table 5.3B shows the percentages of eighth-grade students in public schools 
whose teachers indicated that they had a curriculum specialist available. At grade 8, 
only results from 1996 are available. 

• In Colorado, about half of the students were taught by teachers who 
reported that there was a curriculum specialist available to help or advise 
in mathematics (48 percent). This figure was not significantly different 
from that of students across the nation (52 percent). 
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TABLE 5.3B - GRADE 8 


essmei 


V 

It 


Public School Teachers’ Reports on Curriculum Specialists 





is there a curriculum specialist 
available to help or advise you In 
mathematics? 


Colorado 


West 


Nation 


Percentage and Average Scale Score 









Yea 


48 ( 3.8) 


53 ( 5.5) 


52 ( 3.8) 




277 ( 1 .7) 


266 ( 4.3) 


270(2.1) 


No 


52 ( 3.8) 


47 ( 5.5) 


48 ( 3.8) 




275 ( 1 .8) 


276 ( 2.7) 


275 ( 1.7) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 
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THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



101 



Colorado 



ln>School Teacher Preparation Time 

Teachers were asked to indicate how many school hours they had designated as 
preparation time per week. The question did not restrict preparation time to the 
mathematics classes of those students who took part in the NAEP assessment or 
mathematics classes in general. The question referred to the preparation time allotted 
for all classes taught by the teacher. The responses of public school fourth-grade 
teachers are shown in Table 5.4A. 

o The percentage of students in Colorado whose teachers reported having 
five or more school hours designated as preparation time per week 
(27 percent) was not significantly different from that of students across 
the nation (27 percent). 

• The percentage of Colorado students whose teachers had one to two 
hours to prepare each week (14 percent) was smaller than that of 
students nationwide (21 percent). 
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TABLE 5.4A - GRADE 4 


Public School Teachers’ Reports on Preparation Time 


State Assessment 



Colorado 


West 


Nation 


Percentage and Average Scale Score 



How many school hours do you have 
designated as preparation time per 
week? 



Less than 1 


2 ( 0.8) 


12 ( 3.4) 


7(1.4) 




(«/) 


217(4.7)! 


219(4.2)1 


1-2 


14 ( 2.3) 


27 ( 4.5) 


21 (2.1) 




228 ( 2.3) 


220 ( 4.2) 


222 ( 2.4) 


3-4 


57 ( 3.6) 


36 ( 5.1) 


45 ( 2.5) 




224 ( 1.6) 


221 ( 2.4) 


226 ( 1.4) 


5 hours or more 


27 ( 2.9) 


25 (4.5) 


27 ( 2.6) 




228(2.1) 


216(4.3)1 


221 (2.1) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 
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Table 5.4B shows the percentages of eighth-grade students in public schools 
whose teachers reported on school hours designated for preparation. (Note that the 
question referred to the total amount of preparation time for all classes taught by the 
teacher.) 



• The percentage of Colorado students whose teachers reported having 
five or more school hours designated as preparation time each week 
(49 percent) was smaller than that of students across the nation 
(60 percent). 

• The percentage of students whose teachers had one to two hours to 
prepare each week in Colorado (9 percent) was not significantly 
different from that of students nationwide (6 percent). 
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TABLE 5.4B - GRADE 8 






► 


Public School Teachers ’ Reports on Preparation Time 


State Assessment 





How many school hours do you have 
designated as preparation time per 
week? 


Colorado 


West 


Nation 


Percentage and Average Scale Score 







Less than 1 


3(1.2) 


6 ( 3.6) 


3(1.2) 




289 ( 6.4)! 


277(11.1)1 


268 (10.6)! 


1-2 


9 ( 2.0) 


5(2.1) 


6(1.7) 




277(3.1)! 


268 ( 6.7)! 


261 ( 6.3)! 


3^ 


39 ( 3.3) 


28 ( 4.6) 


30 ( 3.4) 




275 ( 1.9) 


272 ( 5.7) 


275 ( 2.4) 


5 hours or more 


49 ( 3.4) 


61 ( 4.8) 


60 ( 3.7) 




276 ( 1 .7) 


270(2.1) 


272 ( 1.7) 



The NAEP mathematics scale ranges from 0 to 500. The standard eiTors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 
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Parents as Classroom Aides 

When school personnel and parents develop a positive line of communication, they 
strengthen the learning environment for the students both at school and at home. One 
of the most frequent reasons cited by school personnel for contacting parents is to 
request parent volunteer time at school. The principals of the participating public 
schools were asked if parents were used as classroom aides. As shown in Table 5.5A, 
principals for fourth graders reported the following. 

• More than half of the students in Colorado (54 percent) were in schools 
that reported routinely using parents as aides in classrooms. In contrast, 

3 percent of students in Colorado attended schools where parents were 
not used as classroom aides. 

• From 1992 to 1996, the percentage of Colorado students in schools that 
reported routinely using parents as aides in classrooms decreased 
(75 percent in 1992 and 54 percent in 1996). 
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TABLE 5.5A - GRADE 4 


Public Schools ’ Reports on Parents as Aides in Classrooms 





Does your school use parents as aides 
in classrooms? 


Colorado 


West 


Nation 


Percentage and Average Scale Score 











No 


1992 


1 


(....) 


11 1 


[3.2) 


11 1 


[2.5) 






*** 


(".*) 


209 1 


[4.1)1 


2121 


; 4.5)1 




1996 


3 


(1.8) 


8| 


[2.4) 


8( 


;i.7) 






*** 


(”.*) 


2261 


[ 6.0)1 


2191 


; 3.7)1 


Yes, occasionally 


1992 


24 


(4.3) 


37 ( 


[ 5.4) 


42 1 


[3.3) 






215 


(2.7) 


208 1 


[1.5) 


2161 


[1.4) 




1996 


42 


( 4.4)> 


42 1 


[7.2) 


44 1 


[4.8) 






219 


(2.5) 


213 1 


[4.7) 


219 1 


[2.1) 


Yes, routinely 


1992 


75 


(4.2) 


53 1 


[6.5) 


47 ( 


[3.4) 






223 


(1.2) 


226 1 


[2.3) 


2231 


[1.5) 




1996 


54 


( 4.6)< 


51 1 


[7.4) 


48( 


[4.9) 






231 


(1-6)> 


220 1 


[2.4) 


225 1 


[1.9) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher Gower) than the value for 1992 at about the 95 percent confidence level. ! Interpret with caution 
— the nature of the sample does not allow accurate determination of the variability of this statistic. *** Sample size is 
insufficient to permit a reliable estimate. **** Standard error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Table 5,5B shows the percentages of eighth-grade public school students in 
schools whose principals reported on the use of parents as classroom aides. 

• Less than one third of Colorado students (29 percent) were in schools 
that reported routinely using parents as aides in classrooms. In contrast, 
14 percent of students in Colorado attended schools where parents were 
not used as classroom aides. 

• From 1992 to 1996, there was no significant change* in the percentage 
of Colorado students in schools that reported routinely using parents as 
aides in classrooms (19 percent in 1992 and 29 percent in 1996). 
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TABLE 5.5B-GRADE 8 



Public Schools^ Reports on Parents as Aides in Classrooms 



Does your school use parents as aides 


Colorado 


Weat 


Nation 


In classrooms? 


Percentage and Average Scale Score 



No 


1992 


23 I 


(4.4) 


36 1 


(5.9) 


46 1 


(3.9) 






269 I 


(2.9) 


267 1 


(4.9) 


2681 


(2.0) 




1996 


14( 


(3.5) 


27 1 


(7.2) 


. 41 1 


(5.0) 






265 I 


[ 3.7)l 


2651 


[ 3.5)l 


267 1 


(2.2) 


Yes, occasionally 


1992 


56 I 


[5.2) 


481 


(5.6) 


401 


(3.7) 






273 I 


(1.7) 


271 I 


(3.2) 


267 ( 


(2.0) 




1996 


. 58 I 


(4.7) 


56 I 


(8.1) 


46 < 


[4.9) 






274 { 


[1.7) 


270 I 


(3.1) 


274 ( 


[2.4) 


Yes, routinely 


1992 


19 i 


[4.0) 


14 i 


[5.0) 


12( 


[2.7) 






274 { 


: 2.0)1 


266 < 


[4.1)1 


266 4 


[ 2.9)l 




1996 


29 { 


[4.3) 


15 i 


[7.5) 


134 


:3.6) 






283 { 


:2.1)> 


***( 


rn 


273 4 


: 5.1)1 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher Gower) than the value for 1992 at about the 95 percent confidence level. ! Interpret with caution 
— the nature of the sample does not allow accurate determination of the variability of this statistic. *** Sample size is 
insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 




* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” 
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Student Absenteeism 

School principals were asked if student absenteeism was a serious, moderate, or 
minor problem, or not a problem. Table 5. 6 A shows, for fourth graders, results based 
on principals’ reports. 

• In Colorado, 11 percent of the students attended public schools that 
reported that absenteeism was a moderate to serious problem. This 
percentage was not significantly different from that of students across 
the nation (13 percent). 

• The percentage of students in schools reporting that absenteeism was a 
moderate to serious problem in Colorado did not change significantly* 
from 1992 (20 percent) to 1996 (11 percent). 
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TABLE 5.6A - GRADE 4 


Public Schools’ Reports on Student Absenteeism 


State Assessment 



To what degree is student absenteeism 


Colorado 


West 


Nation 


a probiem in your schooi? 


Percentage and Average Scale Score 



Not a problem 


1992 


45 i 


:4.6) 


16< 


:3.7) 


31 4 


[2.7) 






225 { 


:i.7) 


222 < 


: 2.9)1 


226 4 


[1.7) 




1996 


46 { 


:5.2) 


40 4 


: 8.2)> 


43 4 


[4.1) 






230 { 


: 1.8) 


226 4 


: 3.2)1 


230 4 


: 1.8) 


Minor 


1992 


36 1 


[4.6) 


60 4 


[5.0) 


54 1 


(3.1) 






222 1 


(1.5) 


222 4 


[2.2) 


219 1 


[1.4) 




1996 


44 ( 


[5.2) 


444 


[7.4) 


44 ( 


[4.3) 






224 1 


[2.4) 


213 4 


[4.6) 


218 1 


(2.3) 


Moderate to serious 


1992 


20 1 


[2.8) 


24 4 


[4.8) 


15 ( 


(2.2) 






209 1 


(2.6) 


204 1 


[ 3.0)! 


2021 


[2.1) 




1996 


11 ( 


[3.3) 


15 ( 


[4.6) 


13( 


[2.3) 






216 1 


[ 5.0)1 


213 1 


[ 6.2)1 


210 1 


[3.1) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly lugher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret with caution 
— the nature of the sample does not allow accurate determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Table 5,6B shows the percentages of eighth-grade students in public schools where 
principals reported the degree to which absenteeism is a problem, 

• In Colorado, 20 percent of the students attended public schools that 
reported that absenteeism was a moderate to serious problem. This 
figure was not significantly different from that of students nationwide 
(25 percent), 

• There was no significant change in the percentage of Colorado students 
attending schools that reported that absenteeism was a moderate to 
serious problem from 1992 (24 percent) to 1996 (20 percent). 
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TABLE 5.6B - GRADE 8 


Public Schools’ Reports on Student Absenteeism 


State Assessmant 



To what degree Is student absenteeism 


Colorado 


West 


Nation 


a problem In your school? 


Percentage and Average Scale Score 



Not a problem 


1990 


21 i 


[3.7) 


12( 


***•) 


10! 


[4.1) 






276 \ 


[2.1) 


***( 


**.*) 


277 { 


[ 4.8)1 




1992 




[3.3) 


17( 


4.8) 


19! 


[3.1) 






281 i 


[ 3.6)! 


278 ( 


5.8)1 


274 { 


[3.2) 




1996 


26 < 


[4.1)> 


12 ( 


6.4) 


22 { 


[3.7) 






280 < 


[2.9) 


287 ( 


8.3)1 


282 i 


[3.6) 


Minor 


1990 


54i 


[4.7) 


43( 


9.9) 


52 i 


[6.2) 






269 1 


[1.6) 


261 ( 


2.5)1 


262 i 


[2.1) 




1992 


64< 


[ 4.9) 


51 ( 


7.7) 


52 i 


[3.9) 






274 { 


[ 1.4) 


273 ( 


2.3)» 


270 i 


[1.5)» 




1996 


S4{ 


[4.3) 


59( 


7.2) 


54 ( 


(4.4) 






277 { 


[1.5)» 


268 ( 


2.5) 


272 i 


[1.6)« 


Moderate to serious 


1990 


25 i 


[4.3) 


45 ( 


8.9) 


38 ! 


[5.5) 






256 < 


[2.2) 


256 ( 


4.7) 


258 ! 


[2.6) 




1992 


24 { 


[4.1) 


32 ( 


9.4) 


29 i 


[3.9) 






262 { 


[2.1) 


257 ( 


3.9)1 


258 i 


[2.1) 




1996 


20 { 


[3.4) 


28 ( 


7.4) 


25 i 


[3.1) 






264 { 


[3.9) 


264 ( 


4.6)1 


262 i 


[2.4) 



The NAEP mathematics scale ranges from 0 to SOO. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation » («) appears, it signifies that the value for public school students 
was significantly Ugher (lower) than the value for 1990 at about the 95 percent confidence level. If the notation > (<) 
appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 at 
sHyut the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** San^le size is insufficient to permit a reliable estimate. 
♦♦♦♦ Standard error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990, 1992, 
and 1996 Mathematics Assessments. 
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CHAPTER 6 



Classroom Practices Related to Mathematics 
Instruction 

The mathematics achievement of our nation’s students has been the topic of 
considerable discussion in recent years. The mathematics achievement of our students 
does not compare well with that of students in other countries^ or with achievement 
goals set by the United States for itself.” Improvements in mathematics performance 
during the 1980s and 1990s are encouraging;’^ however, policy makers and educators 
must continue to evaluate the state of mathematics education and to commit to 
improvements to school mathematics programs. 

For some of the issues discussed in this chapter, student- and teacher-reported 
results for similar questions are presented. In these situations, some discrepancies may 
exist between student- and teacher-reported percentages. It is not possible to offer 
conclusive reasons for these discrepancies or to determine which reports most accurately 
reflect fourth- and eighth-grade classroom activities. The reports presented represent 
students’ and teachers’ impressions of the frequency of various activities in the 
classrooms. 

An important step in the improvement of mathematics education in the nation’s 
elementary and secondary schools was the development and adoption of the National 
Council of Teachers of Mathematics (NCTM) Curriculum and Evaluation Standards for 
School Mathematics.^^ Already adopted by the majority of the states,*” the NCTM 
Standards represent a basis upon which mathematics instruction can be reformed and 
improved. This chapter focuses on curricular and instructional content issues in 
Colorado public schools and their relationship to students’ mathematics performance. 
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NCTM Standards 

Since their publication in 1989, the NCTM Standards have received considerable 
attention by policy makers and educators. The NCTM Standards outline curriculum and 
evaluation recommendations for kindergarten through grade 12 mathematics instruction. 
To gauge how knowledgeable teachers are about the standards, teachers were asked 
about their familiarity with the NCTM Standards and their involvement in professional 
development related to them. Table 6.1 A shows the results based on the responses of 
fourth-grade public school mathematics teachers. 

« Relatively few of the fourth-grade students in Colorado (10 percent) had 
mathematics teachers who reported being very knowledgeable about the 
NCTM Standards, This percentage was smaller than the percentage 
whose teachers reported having little or no knowledge of the Standards 
(27 percent). 

o The percentage of Colorado fourth graders whose teachers reported 
being very knowledgeable about the NCTM Standards did not differ 
significantly from the percentage for the nation (6 percent). 
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TABLE 6.1A- GRADE 4 



Public School Teachers* Reports on Knowledge of the NCTM 
Standards 



Colorado 


West 


Nation 


Percentage and Average Scale Score 



How knowledgeabie are you about the 
National Council of Teachers of Mathennatics 
(NCTM) Curriculum and Evaluation Standards 
for School Mathematics? 



1 have little or no knowledge. 


27 ( 3.1) 
224 ( 2.5) 


53 ( 3.0) 
219 ( 3.1) 


45 ( 2.4) 
222 ( 1.7) 


Somewhat knowledgeable 


40 ( 3.2) 
227 ( 1 .8) 


26 ( 3.1) 
218 ( 1.6) 


32 ( 2.4) 
222 ( 1.6) 


Knowledgeable 


23 ( 2.8) 
226 (3.1) 


14 ( 3.4) 
220(3.0)! 


18 (2.0) 
222 ( 2.0) 


Very knowledgeable 


10(1.7) 
226 ( 3.8) 


6 ( 2.5) 
226 ( 5.2)1 


6(1.2) 
235 ( 4.8)1 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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Eighth-grade public school mathematics teachers were also asked about their 
knowledge of the NCTM Standards, As presented in Table 6. IB, their responses 
indicate the following. 

• About one fifth of the eighth-grade students in Colorado (22 percent) 
had mathematics teachers who reported being very knowledgeable about 
the NCTM Standards, This percentage was greater than the percentage 
whose teachers reported having little or no knowledge of the Standards 
(11 percent). 

• The percentage of eighth graders in Colorado whose teachers reported 
being very knowledgeable about the NCTM Standards did not differ 
significantly from the percentage for the nation (17 percent). 
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TABLE 6.1 B - GRADE 8 


Public School Teachers* Reports on Knowledge of the NCTM 


State Assessment 


Standards 



Colorado 


West 


Nation 


Percentage and Average Scale Score 



How knowledgeable are you about the 
National Council of Teachers of Mathematics 
(NCTM) Curriculum and Evaluation Standards 
for School Mathematica? 



1 hove little or no knowledge. 


11 (2.1) 
271 ( 3.0) 


17(5.0) 
268 ( 5.2)1 


16(2.6) 
264 ( 3.6) 


Somewhet knowledgeable 


28 ( 3.8) 
273 ( 2.3) 


38 ( 5.3) 
265 ( 4.5) 


34 ( 3.1) 
268 ( 2.9) 


Knowledgeeble 


39 ( 3.8) 
277 ( 2.3) 


25 ( 5.5) 
273 ( 5.3)1 


33 ( 3.9) 
275 ( 2.3) 


Very knowledgeeble 


22 ( 2.7) 
283 ( 2.7) 


20 ( 4.9) 
280 ( 3.7)1 


17(2.7) 
282 ( 2.3) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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Teachers were also asked whether they had participated in any professional 
development activities that provided them with strategies for implementing the NCTM 
Standards. The activities could include local workshops, and regional and national 
NCTM meetings. (Teachers were asked to select all activities that applied.) Table 6.2A 
presents the results for fourth-grade public school mathematics teachers. 

o Less than half of the students in Colorado (46 percent) had mathematics 
teachers who reported attending no professional development activities 
related to implementing the NCTM Standards. This percentage was 
smaller than the percentage for the nation (60 percent). 
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TABLE 6.2A - GRADE 4 


Public School Teachers* Reports on Professional 
Development for Implementing the NCTM Standards 



Have you participated In any profeaalonal 
development activltlea that have provided 


Colorado 


West 


Nation 


you with otrateglea for Implementing the 1989 
NCTM Curriculum and Evaluation Standards 
for School Mathematlca? 


Percentage and Average Scale Score 



Local workshop 


39 ( 3.6) 


24 ( 3.2) 


29 ( 2.5) 




227 ( 2.2) 


219 ( 2.0) 


223(1.9) 


Regional or national NCTM meeting 


16 ( 2.2) 


10(3.3) 


9(1.4) 




225 ( 2.9) 


225 ( 3.0)1 


229(3.1) 


Other 


11 (1.9) 


8 ( 2.9) 


12(1.7) 




225 ( 2.2) 


225 ( 3.7)1 


230 ( 3.3) 


No 


46 ( 3.7) 


65 ( 5.2) 


60 ( 2.8) 




225 ( 1.6) 


217(2.5) 


222 ( 1.3) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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When eighth-grade public school mathematics teachers were asked this question 
(see Table 6.2B), their responses showed the following. 

» About one quarter of the eighth graders in Colorado (27 percent) had 
mathematics teachers who reported attending no professional 
development activities related to implementing the NCTM Standards. 

This percentage did not differ significantly from* the percentage for the 
nation (35 percent). 
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TABLE 6.2B - GRADE 8 



Public School Teachers’ Reports on Professional 
Development for Implementing the NCTM Standards 



Colorado 


West 


Nation 


Percentage and Average Scale Score 



Have you participated in any profeaaionai 
deveiopment activities that have provided 
you with strategies for inripiementing the 1989 
NCTM Curricuiunr} and Evaiuation Standards 
for Schooi Mathematics? 



Local workshop 


56 ( 3.4) 


46(4.4) 


51 ( 2.9) 




270 ( 1.5) 


276 ( 2.5) 


276 ( 2.0) 


Regional or national NCTM meeting 


37 ( 3.2) 


31 ( 4.9) 


25(3.1) 




279 ( 2.4) 


273(3.1) 


276 ( 2.2) 


Other 


25 ( 3.0) 


13 ( 3.4) 


16(2.4) 




276 ( 2.6) 


273 ( 5.6)1 


274 ( 2.6) 


No 


27 ( 2.7) 


36 ( 4.6) 


35(3.1) 




270 ( 2.3) 


266 ( 3.0) 


267 ( 2.3) 



The NAEP mathematics scale ranges from 0 to SOO. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). I Int^ret with caution — the nature of the sample does not allow accurate 
determination of ^e variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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* Although the difference may appear large, recall that ^^significance** here refers to “statistical significance.** 
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Course-Taking Patterns 

To investigate the relationship between the mathematics performance of students 
and their study of mathematics in school, information on the types of mathematics 
classes in which students were enrolled and the amount of time each week spent on 
mathematics instruction in class was collected. 

Typically, all fourth-grade students take mathematics. Most eighth graders, with 
a few exceptions, also take mathematics. However, by the time a student reaches the 
eighth grade, different types of mathematics courses are available. Eighth graders in 
Colorado were asked about the mathematics class they were currently taking and about 
the class they expected to take in the ninth grade. Based on their responses, shown in 
Table 6.3: 

• In eighth grade, about one third of the students reported taking 
eighth-grade mathematics (34 percent), compared to 32 percent taking 
prealgebra and 28 percent taking algebra. The percentage of students 
taking algebra did not differ significantly from that for the nation 
(24 percent). 

• Less than half of the eighth-grade students expected to take prealgebra 
(9 percent) or algebra (30 percent) in the ninth grade. Another 
26 percent anticipated taking a geometry class. 
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TABLE 6.3 - GRADE 8 



Public School Students^ Reports on their Mathematics Classes 





What kind of mathematics ciass . . . 


Colorado 


West 


Nation 


Percentage and Average Scale Score 











Are you taking this year?* 
Eighth-grade mathematics 


34 ( 2.6) 
265 ( 1.5) 


46 ( 2.5) 
261 ( 2.3) 


44 ( 2.3) 
261 ( 1.5) 


Prealgebra 


32 ( 2.3) 
270 ( 1 .7) 


25 ( 2.5) 
272 ( 3.0) 


27 ( 1.9) 
269 ( 1.6) 


Algebra 


26 ( 1 .2) 
296 ( 1.9) 


23 ( 1.2) 
289 ( 3.7) 


24 ( 1.6) 
294 ( 1.8) 


Integrated or sequential mathematics 


1 ( 0.5) 
*** 


1 ( 0.2) 


1 ( 0.3) 
260 ( 6.6)1 


Applied mathematics (technical preparation) 


0(0.1) 

*** 


0(0.1) 

*** 


0 ( 0.0) 
*** 


Other mathematics class 


4 ( 0.5) 
279 ( 5.5) 


4 ( 0.9) 
253 ( 7.9)1 


3 ( 0.5) 
264 ( 5.6) 


Do you expect to take In ninth grade? 
1 do not expect to take mathematics 
in ninth grade. 




1 ( 0.3) 

*** 


1 ( 0.2) 


Basic, general, business, or consumer 
mathematics 


7 ( 0.8) 
252 ( 3.1) 


9(1.2) 
249 ( 3.2) 


6 ( 0.7) 
250 ( 2.3) 


Applied mathematics (technical preparation) 


2 ( 0.4) 
*** 1 ** 


2 ( 0.4) 
*** 


2 ( 0.3) 
256 ( 3.9) 


Prealgebra 


9 ( 0.6) 
264 ( 2.6) 


10 ( 1.2) 
256 ( 3.0) 


11 (1.0) 
257(2.1) 


Algebra 1 or elementary algebra 


30 ( 1.4) 
279 ( 1.6) 


29 ( 2.4) 
276 ( 3.3) 


32 ( 1.4) 
275 ( 1 .3) 


Geometry 


26 ( 1.5) 
295 ( 1.9) 


22 ( 1.1) 
287 ( 3.9) 


20 ( 1.4) 
293 ( 2.3) 


Integrated or sequential mathematics 


1 ( 0.4) 
*** 


1 ( 0.3) 

*** 


2 ( 0.4) 
275 ( 7.2)! 


Other mathematics class 


3 ( 0.3) 
304 ( 6.2) 


2 ( 0.5) 

*** 


3 ( 0.5) 
292 ( 3.9) 


1 don’t know. 


20 ( 0.9) 
261 ( 1 .7) 


24 ( 2.0) 
259 ( 1 .9) 


22 ( 1.4) 
261 ( 1 .6) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). * Percentages may not total 100 percent because a small number of students 
reported that they are not taking a mathematics class. ! Interpret with caution — ■ the nature of the sample does not allow 
accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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The amount of time spent on mathematics instruction within the classroom also 
varies from school to school and from state to state/^ The teachers of the fourth graders 
participating in the NAEP assessment were asked about the amount of time spent each 
week on mathematics instruction. Table 6.4A presents the public school teachers’ 
responses. 

» In 1996, about two thirds of the students in Colorado had teachers who 
reported spending four or more hours on mathematics instruction 
(66 percent), compared to 7 percent who reported spending two and a 
half hours or less. The average scale score for students receiving four 
or more hours of mathematics instruction (228) was not significantly 
different from* that for students receiving two and a half hours or less 
( 221 ). 

• The percentage of fourth graders in Colorado whose teachers reported 
spending four hours or more on mathematics instruction was not 
significantly different from the percentage for the nation (69 percent). 

o The percentage of Colorado fourth graders in 1996 whose teachers 
reported spending four hours or more on mathematics instruction did 
not differ significantly from the percentage in 1992 (63 percent). 
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Public School Teachers* Reports on Time Spent on 
Mathematics Instruction 



How much timo do you spend each week on 


Colorado 


West 


Nation 


mathematics Instruction with this class? 


Percentage and Average Scale Score 



2Vb houre or lees 1882 


7(1.7) 


5 ( 2,2) 


5( 1,0) 




216(4.0)1 


••• I** 


224 ( 3.7)1 


1886 


7(1,6) 


6(1,9) 


6(1.1) 




221 ( 6.6)1 


227 ( 4.0)1 


226 ( 2.6)1 


Moro than 2Vb hours but lose than 4 hours 1882 


30 ( 3.2) 


24 ( 3.6) 


21 (2.1) 




224 ( 1.6) 


226 ( 6.7) 


222 ( 2.6) 


1886 


27 ( 2.7) 


22 ( 4.6) 


26 ( 2.6) 




223 ( 2.2) 


220 ( 6.4)1 


226 ( 1.8) 


4 hours or moro 1882 


63 ( 3.6) 


71 ( 4.8) 


74 ( 2.6) 




220 ( 1.6) 


216 ( 1,7) 


217 ( 1,1) 


1886 


66 ( 3.2) 


71 ( 4,6) 


68 ( 2.6) 




226( 1.3)> 


220 ( 1.7) 


222 ( 1.1)> 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses, It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of Ae estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level, ! Interpret with caution 
— the nature of the sample does not allow accurate determination of ths variability of this statistic, *** Sample size is 
insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 



* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” 

National Center for Education Statistics. Schools and Staffing in the United States: A Statistical Profile, 1993-94. 
(Washington, DC: National Center for Education Statistics, 1996). 
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Eighth-grade mathematics teachers were also asked about the amount of time 
dedicated to mathematics instruction. Based on the responses of public school teachers 
in Colorado, the results are shown in Table 6.4B. 

• About one quarter of the eighth graders in 1996 had teachers who 
reported spending four or more hours on mathematics instruction 
(26 percent), compared to 27 percent who reported spending two and 
a half hours or less. The average scale score for students receiving four 
or more hours of mathematics instruction (275) was not significantly 
different from that for students receiving two and a half hours or less 
(274). 

o The percentage of eighth graders whose teachers reported spending four 
hours or more on mathematics instruction in Colorado was not 
significantly different from* the percentage for the nation (34 percent). 

• The percentage of students in 1996 whose teachers reported spending 
four hours or more on mathematics instruction did not differ 
significantly from the percentage in 1992 (27 percent). 
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TABLE 6.4B - GRADE 8 



Public School Teachers* Report on Time Spent on 
Mathematics Instruction 





How much time do you spend each week on 
mathematics Instruction with this class? 


Colorado 


West 


Nation 


Percentage and Average Scale Score 











216 hours or less 


1992 


18 i 


:2.3) 


19 < 


(5.6) 


13 i 


(2.2) 






273 { 


:2.6) 


272 I 


: 6.7)1 


270 i 


(3.9) 




1996 


27 { 


:3.2) 


24 i 


(5.0) 


20 < 


(3.2) 






274 { 


:2.3) 


270 { 


: 2.7)! 


266 1 


(3.2) 


More than 216 hours but less than 4 hours 


1992 


55 { 


[3.4) 


51 { 


(1.9) 


55 1 


(2.7) 






273 { 


:i.5) 


267 { 


(3.3) 


269 1 


(1.5) 




1996 


48 i 


:3.6) 


AO{ 


(4.7) 


46( 


(3.5) 






277 ( 


(1.9) 


269 { 


(3.6) 


274 ( 


(1.8) 


4 hours or more 


1992 


27 ( 


(2.8) 


30 1 


(5.4) 


32 1 


(3.1) 






270 ( 


(2.3) 


267 1 


(3.2) 


267 1 


(2.2) 




1996 


26 1 


(2.6) 


36 1 


(6.6) 


34 1 


(3.5) 






275 ( 


(2.5) 


274 ( 


( 3.9)1 


273 1 


(3.1) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appef_r in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly Wgher Gower) than the value for 1992 at about the 95 percent confidence level. ! Interpret with caution 
— the nature of the sample does not allow accurate determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 




♦ Although the difference may appear large, recall that “significance” here refers to “statistical significance.” 
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Instructional Emphasis 



The framework or blueprint that guided the development of the NAEP 1996 
mathematics assessment identified three mathematical abilities — conceptual 
understanding, procedural knowledge, and problem solving. The NCTM Standards 
emphasize the need to give students the opportunity to develop all three abilities. 
Focusing on only one of these abilities is limiting to students’ mathematical 
development. For example, emphasizing how to do a problem (procedural knowledge) 
without understanding why it works (conceptual understanding) or when to use it 
(problem solving) offers students, at best, an incomplete picture of mathematics. These 
three abilities were reflected in the specifications for the 1990, 1992, and 1996 NAEP 
mathematics assessments. Questions assessing all of these abilities were included. Also 
identified by the NCTM Standards is the ability to reason which depends upon all three 
of the previous abilities, and the need for students to be able to communicate 
mathematical ideas. To assess the students’ opportunities to experience a variety of 
learning, teachers were asked how often they addressed skills related to these abilities. 
Table 6.5 A shows the results based on responses given by grade 4 teachers. 

• A large majority of the fourth graders had teachers who reported they 
addressed the learning of mathematics facts and concepts a lot 
(89 percent), while a small percentage (1 percent) had teachers who 
reported spending little or no time on the topic. 

• A large majority of the students had teachers who reported they 
addressed the learning of skills and procedures a lot (85 percent). At 
the other extreme, 2 percent of the students had teachers who reported 
spending little or no time on the topic. 

• Teachers of 45 percent of the students reported they addressed the 

developing of reasoning and analytical ability a lot. In contrast, 

9 percent had teachers who reported spending little or no time 
addressing the topic. 

• In terms of addressing the learning of how to communicate ideas in 
mathematics clearly, 35 percent of fourth graders had teachers who 
reported doing so a lot, while 16 percent of the students had teachers 
who reported spending little or no time addressing the topic. 
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TABLE 6.5A- GRADE 4 



Public School Teachers’ Reports on Skills Addressed 



In this mathematics class, how often do you 


Colorado 


West 


Nation 


address each of the following? 


Percentage and Average Scale Score 



Learning mathematics facta and concepts 
A little or none 


1 ( 0.7) 


0 (••••) 


0 (•**•) 




••• (••.•) 


••• 


••• 


Some 


10 ( 2.0) 


7( 1.7) 


7(1.1) 




220 ( 4.0) 


222 ( 6.3)1 


221 ( 3.5) 


A lot 


89 ( 2.1) 


92 ( 1.7) 


93 ( 1.1) 




227 ( 1.1) 


220 ( 2.0) 


223 ( 1.1) 


Learning akills and procedurea needed 
to aolve routine problema 
A little or none 


2 ( 0.6) 


0 (••••) 


0 (••••) 




••• (••.•) 


••• (••.*) 




Some 


14(2.3) 


10(2.5) 


9(1.3) 




220 ( 3.3) 


222 ( 6.5)1 


220 ( 3.9) 


A lot 


85 ( 2.5) 


90 ( 2.5) 


91 ( 1.3) 




228 ( 1.1) 


220(2.1) 


223( 1.1) 


Developing reasoning and analytical 
ability to aolve unique problema 
A little or none 


9( 1.6) 


4(1.1) 


7(1.2) 




219 ( 4.3) 


210 ( 8.5)1 


222 ( 3.4) 


Some 


47(3.1) 


36 ( 4.3) 


39 ( 2.6) 




225 ( 1.9) 


214 ( 2.7) 


219 ( 1.7) 


A lot 


45 ( 3.2) 


60 ( 4.6) 


54 ( 2.5) 




228 ( 1.7) 


225 ( 2.6) 


226( 1.6) 


Learning how to communicate Ideas In 
mathematics effectively. 

A little or none 


16(2.2) 


13 ( 3.5) 


17(1.9) 




221 ( 2.9) 


222 ( 4.3)l 


227 ( 2.1) 


Some 


49 ( 2.9) 


49 ( 5.2) 


44 ( 2.7) 




226( 1.6) 


216 ( 3.6) 


219(2.0) 


A lot 


35 ( 3.2) 


39 ( 4.3) 


39 ( 2.6) 




228 ( 2.0) 


226 ( 2.5) 


225 ( 1.6) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent conHdence that, fbr each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). I Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of tMs statistic. Sample size is insufficient to permit a reliable estimate. 
**** Standard error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 
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Eighth-grade mathematics teachers were also asked about the degree to which they 
addressed the mathematical abilities (Table 6.5B). 

• About three quarters of the eighth graders had teachers who reported 
they addressed the learning of mathematics facts and concepts a lot 
(74 percent), while a small percentage (6 percent) had teachers who 
reported spending little or no time on the topic. 

• About three quarters of the students had teachers who reported they 
addressed the learning of skills and procedures a lot (77 percent). At 
the other extreme, 3 percent of the students had teachers who reported 
spending little or no time on the topic. 

• Teachers of 45 percent of the students reported they addressed the 
developing of reasoning and analytical ability a lot. A small percentage 
of the students (8 percent) had teachers who reported spending little or 
no time addressing the topic. 

• In terms of addressing the learning of how to communicate ideas in 
mathematics clearly, 38 percent , of eighth graders had teachers who 
reported doing so a lot while 18 percent of students had teachers who 
reported spending little or no time on the topic. 
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TABLE 6.5B - GRADE 8 


Public School Teachers* Reports on Skills Addressed 


State Assessment 



In this mathematics ciass, how often do you 


Colorado 


West 


Nation 


address each of the following? 


Percentage and Average Scale Score 



Learning mathematics facts and concepts 
A little or none 


6(1.3) 


8(2.1) 


5(1.7) 




286 ( 7.9)l 


271 (11.2)1 


276 ( 5.4)1 


Some 


20 ( 3.0) 


23 ( 5.9) 


16(2.4) 




275 ( 3.4) 


263 ( 3.7)1 


269 ( 2.7) 


A lot 


74 ( 3.2) 


69 ( 6.9) 


79 ( 3.0) 




275 ( 1 .4) 


274(2.2) 


273 ( 1.6) 


Learning akttts and procedures needed 
to solve routine problems : 








A little or none 


3 ( 0.7) 


3(1.3) 


3 ( 0.9) 




301 ( 5.8)1 


*** 


278 ( 7.5)1 


Some 


20 ( 2.9) 


32 ( 5.9) 


18(2.6) 




273 ( 3.3) 


270 ( 4.2) 


273 ( 2.9) 


A lot 


77 ( 2.9) 


65(6.0) 


79 ( 2.7) 




275 ( 1 .4) 


272 ( 1.7) 


272 ( 1 .5) 


Developing reasoning and analytical 
ability to solve unique problems 








A little or none 


8(1.5) 


9(1.6) 


8(1.6) 




263 ( 3.6) 


246 ( 7.8)1 


251 ( 5.7)1 


Some 


47 ( 3.0) 


37 ( 2.5) 


40 ( 3.4) 




271 ( 1.9) 


265 ( 2.9) 


266 ( 2.0) 


A lot 


45 ( 3.0) 


54 ( 2.6) 


52 ( 3.3) 




283 ( 1 .8) 


280 ( 3.0) 


281 ( 1 .5) 


Learning how to communicate Ideas In 
mathematics effectively 








A little or none 


18(2.5) 


12 ( 1.9) 


16 ( 2.0) 




269 ( 2.8) 


257 (10.3)! 


263 ( 3.8) 


Some 


44 ( 3.8) 


51 ( 4.4) 


42 ( 3.2) 




273 ( 2.1) 


272 ( 3.4) 


271 ( 2.3) 


A lot 


38 ( 3.7) 


37 ( 4.4) 


42 ( 3.2) 




283 ( 2.3) 


275 ( 3.3) 


278 ( 2.0) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. Sample size is insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 
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Communicating Mathematical Ideas 

Much focus in the mathematics education reform effort has been placed on 
students’ ability to communicate their understanding of mathematics to others. Results 
presented previously in Tables 6.5A and 6.5B examines the level of emphasis teachers 
placed on communication in their classroom. As a follow-up, the students participating 
in the NAEP assessment, and their teachers, were asked about how often they were 
asked to write a few sentences about solving a mathematical problem and how often they 
were asked to discuss solutions to mathematics problems with other students. 

Based on the responses of the fourth-grade public school teachers in Colorado, the 
results are shown in Table 6.6A. 

' . • Relatively few of the students were asked to write about solving a 

mathematics problem (9 percent) and about one third were asked to 
discuss solutions with other students (33 percent) almost every day. 

By comparison, 24 percent were never or hardly ever asked to write 
about their solutions and 4 percent were never or hardly ever asked to 
discuss their solutions. 

• The average scale score for students who were asked to discuss solving 
a mathematics problem almost every day (229) was riot significantly 
different from* that for students who never or hardly ever discussed 
their solutions (217). 



When Colorado fourth-grade public school students were asked about how often 
they wrote about or discussed solutions to mathematics problems, they reported the 
following: 

• About one fifth of the students said they were asked to write about 
mathematics solutions (19 percent) and less than one fifth said they 
were asked to discuss their solutions with other students (17 percent) 
almost every day. At the other end of the continuum, 32 percent of 
students said they were never or hardly ever asked to write about 
solutions and 29 percent said they were never or hardly ever asked to 
discuss their solutions. 




* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” 
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TABLE 6.6A - GRADE 4 


Public School Teachers’ and Students’ Reports on Writing 
About and Discussing Mathematics Problems 


State Assessment 



How often do the students in this ciass 
(do you) do each of the foiiowing? 


Colorado 


West 


Nation 


Teacher 


Student 


Teacher 


Student 


Teacher 


Student 


Percentage and Average Scale Score 



Write a few sentences about how 
to soive a mathematics probiem 
























Never or hardly ever 


24 1 


(3.1) 


32 1 


( 1.5) 


24 ( 3.5) 


30 1 


(2.0) 


27 I 


(2.4) 


33 1 


(1.4) 




226 1 


(2.3) 


228 1 


( 1.5) 


216 (3.1) 


222 1 


(2.2) 


220 1 


(1.7) 


226 1 


(1.3) 


Once or twice a month 


38 1 


(3.3) 


20 1 


( 1.0) 


29 ( 4.6) 


18 1 


( 1.0) 


35 1 


(2.8) 


17 1 


(0.7) 




224 1 


( 1.6) 


231 1 


( 1.8) 


220 ( 5.2) 


229 1 


(2.4) 


223 1 


(2.5) 


231 1 


(1.3) 


Once or twice a week 


29 1 


(3.3) 


29 1 


(1.1) 


34 ( 2.4) 


27 4 


( 1.2) 


27 1 


(2.2) 


27 I 


(0.9) 




229 1 


(2.1) 


226 1 


(1.7) 


221 ( 3.0) 


219 1 


(3.2) 


223 1 


( 1.8) 


223 1 


(1.6) 


Almost every day 


9 1 


(1.6) 


19 ( 


( 1.3) 


13 ( 3.2) 


25 4 


( 1.9) 


10 1 


( 1.6) 


22 4 


( 1.2) 




226 1 


(3.1) 


217 ( 


(2.2) 


231 ( 4.8)! 


210 4 


(3.1) 


233 4 


(3.2) 


211 4 


(1.9) 


Discuss soiutions to mathematics 
probiema with other students 
























Never or hardly ever 


4( 


[ 1.0) 


29 4 


: 1.3) 


2(1.1) 


32 4 


( 1.3) 


6 4 


(1.4) 


33 4 


(1.0) 




217 ( 


(7.1)1 


224 4 


: 1.5) 


... (.. .j 


219 4 


(2.0) 


219 4 


( 3.0)1 


222 4 


(1.0) 


Once or twice a month 


18 ( 


(2.6) 


21 4 


(0.9) 


22 ( 2.6) 


18 4 


(0.9) 


22 4 


(1.7) 


18 4 


(0.6) 




220 1 


(2.5) 


231 4 


(1.7) 


218 ( 2.8) 


223 4 


(3.1) 


221 4 


( 1.9) 


227 4 


(1.7) 


Once or twice a week 


45 ( 


(3.0) 


33 4 


(1.2) 


40 ( 3.9) 


30 4 


(0.8) 


37 4 


(2.3) 


29 4 


(0.7) 




227 ( 


( 1.6) 


227 4 


: 1.3) 


217 ( 3.3) 


220 4 


(2.9) 


221 4 


( 1.9) 


224 4 


(1.4) 


Almost every day 


33 1 


(3.5) 


17 4 


(0.9) 


36 ( 3.2) 


20 4 


[ 1.5) 


35 4 


(2.1) 


19 4 


(0.8) 




229 1 


(1.9) 


220 4 


(2.0) 


228 ( 1.9) 


215 4 


(3.0) 


227 4 


( 1.8) 


217 4 


(1.5) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that; for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 
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Similarly, mathematics teachers of eighth-grade students in Colorado’s public 
schools were asked about the extent to which they had their students writing or 
discussing mathematics solutions. The eighth graders were also asked about the 
frequency of these activities. Table 6.6B shows the following on the basis of the reports 
of teachers in Colorado: 

• A small percentage of the students were asked to write about solving a 
mathematics problem (5 percent) and about half were asked to discuss 
solutions with other students (48 percent) almost every day. By 
comparison, 31 percent were never or hardly ever asked to write about 
their solutions and 3 percent were never or hardly ever asked to discuss 
their solutions. 



An examination of the responses of eighth-grade public school students in 
Colorado showed the following (also shown in Table 6.6B): 

• Relatively few of the students said they were asked to write about 
mathematics solutions (10 percent) and less than half said they were 
asked to discuss their solutions with other students (40 percent) almost 
every day. At the other end of the continuum, 45 percent of students 
said they were never or hardly ever asked to write about solutions and 
17 percent said they were never or hardly ever asked to discuss their 
solutions. 
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TABLE 6.6B - GRADE 8 


Public School Teachers’ and Students’ Reports on Writing 
About and Discussing Mathematics Problems 


State Assessment 



How often do the students in this ciass 
(do you) do each of the foiiowing? 


Colorado 


West 


Nation 


Teacher 


Student 


Teacher 


Student 


Teacher 


Student 


Percentage and Average Scale Score 



Write s few sentences sbout how 






















to so/ve s msthemsttcs problem 






















Never or herdly ever 


31 ( 3.1) 


451 


:i.9) 


27 ( 4.3) 


39 1 


(3.8) 


31 ( 


(3.3) 


47 ( 


(1.8) 




273 ( 2.1) 


277 { 


:i.6) 


274 ( 5.0)! 


271 1 


(2.7) 


271 ( 


(2.8) 


275 ( 


(1.6) 


Once or twice e month 


46 ( 3.7) 


22| 


;i.i) 


36 ( 4.4) 


19 1 


(1.5) 


36 1 


(3.0) 


19 ( 


(1.0) 




274 ( 1.9) 


2761 


: 1.6) 


265 ( 3.6) 


271 ( 


(3.2) 


273 ( 


(2.3) 


274 ( 


(1.7) 


Once or twice a week 


19 ( 2.6) 


231 


:i.i) 


30 ( 4.8) 


24 1 


(1.9) 


27 ( 


(3.1) 


21 ( 


(0.9) 




262 ( 3.4) 


2751 


:i.9) 


275 ( 2.6)1 


2691 


(2.5) 


274 ( 


(2.9) 


267 1 


(1.7) 


Almost every dey 


5(1.5) 


101 


:i.o) 


5 ( 2.2) 


16 1 


(1.9) 


5 1 


(1.1) 


14 1 


(0.9) 


Discuss solutions fo msthemstics 


261 ( 6.0)1 


2661 


:2.8) 


270 ( 8.4)1 


263 1 


(3.5) 


270 ( 


[ 4.4)1 


261 1 


(2.3) 


probIsms with other students 






















Never or herdly ever 


3(0.7) 


171 


:o.9) 


5 ( 2.7) 


16 1 


(1.4) 


21 


(0.8) 


20 1 


(0.8) 




(**,*) 


266 1 


(1.9) 




262 1 


(2.6) 


261 1 


[ 5.7)1 


266 1 


(1.5) 


Once or twice e month 


22 ( 3.5) 


15 ( 


[0.7) 


11 (3.7) 


13 ( 


(0.8) 


12 1 


(2.0) 


14 ( 


(0.5) 




271 ( 2.4) 


274 ( 


(2.1) 


269 ( 5.9)1 


273 ( 


(4.4) 


264 1 


(4.7) 


273 ( 


(2.0) 


Once or twice a week 


26 ( 3.0) 


29 1 


(1.0) 


35 ( 6.0) 


30 1 


(1.2) 


38 1 


(3.3) 


29 1 


(0.8) 




276 ( 2.2) 


276 1 


(1.8) 


270 ( 5.3)1 


2661 


(2.9) 


270 ( 


(2.4) 


270 1 


(1.5) 


Almost every dey 


48 ( 3.4) 


40 1 


[1.1) 


49 ( 7.1) 


39 1 


(1.8) 


48 1 


(3.6) 


36 ( 1.2). 




276 ( 2.2) 


279 1 


[1.5) 


273 ( 1.8) 


273 1 


(2.1) 


276 1 


(1.4) 


274 ( 1.4) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 
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Collaboration in Small Groups 

In many subject areas, researchers have found benefits from having students work 
collaboratively in small groups.^® To examine the extent to which small groups are 
being used in instruction, students and their mathematics teachers were asked about the 
prevalence of these practices. 

Table 6.7A shows the following based on the reports of fourth-grade public school 
mathematics teachers: 

• A large majority of the fourth-grade students in Colorado worked 
mathematics problems in small groups every day (22 percent) or once 
or twice a week (62 percent); a small percentage of the fourth graders 
never or hardly ever worked in groups (2 percent). 



According to fourth graders’ responses: 

• In Colorado, 10 percent worked mathematics problems in small groups 
every day and another 3 1 percent worked in small groups once or twice 
a week. About one third of the fourth graders reported never or hardly 
ever working in groups (35 percent). 
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TABLE 6.7A - GRADE 4 


Public School Teachers ’ and Students ’ Reports on Solving 
Mathematics Problems in Small Groups or With a Partner 



How often do the students in this class 
(do you) solve mathematics problems 
in small groups or with a partner? 


Colorado 


West 


Nation 


Teacher 


Student 


Teacher 


Student 


Teacher 


Student 


Percentage and Average Scale Score 



Never or hardly ever 


2 ( 0.7) 


35 ( 1.5) 


4(1.2) 


39 ( 2.3) 


7(1.6) 


42 ( 1.3) 




... CV) 


224 ( 1.5) 


216 ( 7.7)! 


220 ( 1.7) 


224 ( 2.9)1 


222 ( 1.0) 


Once or twice a month 


14 ( 2.4) 


24 ( 1.1) 


19 ( 2.0) 


21 ( 1.2) 


18 ( 1.5) 


22 ( 0.7) 




222 ( 3.3) 


235 ( 1.3) 


214 ( 2.5) 


229 ( 2.6) 


218 ( 1.7) 


233 ( 1.3) 


Once or twice a week 


62 ( 3.3) 


31 ( 1.4) 


44 ( 3.7) 


28 ( 1.7) 


50 ( 2.2) 


26 ( 1.0) 




227 ( 1 .5) 


226 ( 1.5) 


221 (3.1) 


216 ( 2.6) 


222 ( 1.6) 


221 ( 1 .4) 


Almost every day 


22 ( 2.6) 


10 ( 0.9) 


33 ( 3.6) 


12(1.4) 


25 (2.1) 


10(0.7) 




227 ( 2.7) 


213 ( 2.5) 


224 ( 3.2) 


204 ( 4.3) 


227 ( 1.9) 


205 ( 2.3) 



The NAEP mathematics scale ranges ftx>m 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. ♦♦♦ Sample size is insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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Eighth graders and their mathematics teachers were also asked about working in 
small groups. According to public school mathematics teachers in Colorado, the 
following was true (see Table 6.7B): 

• About three quarters of the students in Colorado worked mathematics 
problems in small groups every day (31 percent) or once or twice a 
week (44 percent); relatively few of the eighth graders never or hardly 
ever worked in groups (10 percent). 



When eighth-grade students were asked, they reported the following: 

• In Colorado, 22 percent worked mathematics problems in small groups 
every day and another 31 percent worked in small groups once or twice 
a week. About one quarter of the eighth graders reported never or 
hardly ever working in groups (23 percent). 
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TABLE 6.7B - GRADE 8 


Public School Teachers’ and Students’ Reports on Solving 
Mathematics Problems in Small Groups or With a Partner 


Stats Assessment 



How often do the students in this dass 
(do you) soive mathematics probtems 
in smaii groups or with a partner? 


Colorado 


West. 


Nation 


Teacher 


Student 


Teacher 


Student 


Teacher 


Student 


Percentage and Average Scale Score 



Never or hardly ever 


10(2.0) 


23 ( 1.8) 


3(1.0) 


24 ( 3.2) 


7(1.5) 


27 1 


:i.6) 




265 ( 4.0) 


272 ( 1.9) 


*** (**.*) 


267 ( 4.1) 


272 ( 5.8)1 


268 4 


:i.8) 


Once or twice a month 


15(2.1) 


24 ( 1.4) 


25 ( 5.9) 


23 ( 1.0) 


27 ( 3.7) 


27 1 


:i.2) 




274 ( 3.9) 


279(2.1) 


274 ( 5.5)1 


272 ( 3.1) 


272 ( 3.2) 


275 1 


:i.5) 


Once or twice a week 


44 ( 3.3) 


31 ( 1.3) 


41 (6.1) 


32 ( 2.0) 


40 ( 3.4) 


29 4 


:i.2) 




278 ( 2.0) 


277 ( 1 .4) 


268 ( 3.0) 


269 ( 2.3) 


271 ( 2.1) 


271 4 


:i.5) 


Almost every day 


31 ( 3.6) 


22 ( 1 .5) 


31 ( 7.4) 


22 ( 1.9) 


27 ( 3.3) 


174 


:i.4) 




277 ( 2.8) 


275 ( 1 .8) 


273 ( 3.0)! 


268 ( 3.5) 


275 ( 2.2) 


269 4 


:3.o) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 



123 

O 

ERIC 



THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



127 



Colorado 



Mathematics Homework 

To examine the relationship between homework and mathematics performance, 
teachers of assessed students were asked to report the amount of mathematics homework 
they assigned each day, and students were asked to report the amount of time they spent 
on mathematics homework each day. 

Tables 6.8A and 6.8B show the teachers’ and students’ responses for fourth- and 
eighth-grade public school students in Colorado. (Students had an additional response 
choice “I am not taking mathematics this year,” but no analogous option was available 
to teachers.) According to fourth-grade teachers’ responses: 

• In Colorado, a large majority of the fourth graders in 1996 were assigned 
15 minutes (57 percent) or 30 minutes (32 percent) of mathematics 
homework each day. 

• A small percentage (8 percent) were not assigned any mathematics 
homework each day. 



According to students in the fourth grade: 

• A small percentage of the fourth graders did not spend any time on 
mathematics homework on a typical day (7 percent). By comparison, 
37 percent spent 15 minutes and 29 percent spent 30 minutes on their 
mathematics homework. 

Results based on the responses of the eighth-grade teachers indicated the 
following: 

• In Colorado, about two thirds of the eighth graders in 1996 were 
assigned 30 minutes (50 percent) or 45 minutes (19 percent) of 
mathematics homework each day. 

• A small percentage (1 percent) were not assigned any mathematics 
homework each day. 

The eighth graders’ reports indicated that: 

• A small percentage of the eighth graders did not spend any time on 
mathematics homework on a typical day (6 percent). By comparison, 
35 percent spent 30 minutes and 18 percent spent 45 minutes on their 
mathematics homework. 
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TABLE 6.8A - GRADE 4 


Public School Teachers* and Students* Reports on Homework 



Approximately how much mathematics 
homework do you assign (time do you 
spend on math homework) each day? 


Colorado 


West 


Nation 


Teacher 


Student 


Teacher 


Student 


Teacher 


Student 


Percentage and Average Scale Score 



1 am not taking mathematics 


























this year. 


1992 


( 

— ( 


h.-) 


2 ( 0.4) 


(-.-) 

(-.-) 

“ (-.-) 


1 ( 0.4) 
1 ( 0.4) 


— 


(-.-) 

(-.-) 

(-.-) 


1 ( 0.2) 




1996 


— ( 


— 










••• 1 


(••.•) 


(.,.) 


••• 1 


(-.•) 


— 


(“.-) 


••• 


(••.•) 


None 


1992 


11 ( 


[1.7) 


9 


(0.7) 


5 ( 2.5) 


8 


(1.8) 


6 


( 1.4) 


7 


(0.6) 






220 4 


[2.6) 


225 


(2.4) 


••• 


226 


( 3.6)1 


221 


( 2.6)1 


222 


(2.3) 




1996 


84 


[1.5) 


7 1 


(0.7) 


3 ( 2.0) 


6 


(0.9) 


4 


(0.8) 


6 


(0.6) 






230 4 


[ 2.6)! 


229 


(3.5) 


• •• ^ee 


223 


(4.3) 


232 


(3.8) 


226 


(3.2) 


15 minutes 


1992 


53 4 


[3.0) 


36 


(1.0) 


65 ( 3.6) 


41 1 


(1.7) 


53 


(2.1) 


39 < 


(1.1) 






224 4 


[1.5) 


224 


(1.3) 


223 ( 2.6) 


220 1 


(2.1) 


221 


(1.4) 


221 < 


(1.2) 




1996 


57 4 


[2.8) 


37 


(1.0) 


61 ( 2.8) 


41 1 


(1.8) 


50 


(2.6) 


40 


(1.1) 






225 4 


[1.4) 


228 1 


( 1.5) 


220 ( 1.9) 


220 1 


(2.4) 


225 


( 1.6) 


224 


(1.3) 


30 minutes 


1992 


30 4 


[2.7) 


27 1 


( 1.0) 


24 ( 3.3) 


30 1 


(1.4) 


36 


(2.6) 


29 


(0.8) 






220 4 


[2.0) 


224 1 


(1.3) 


212(4.1) 


221 1 


(1.3) 


216 


(1.8) 


222 


(1.0) 




1996 


32 4 


[2.8) 


29 1 


(0.9) 


33 ( 2.9) 


27 1 


(1.6) 


40 


(2.5) 


29 


(0.8) 






226 4 


[1.8) 


229 1 


(1.2)> 


221 ( 4.3) 


224 1 


(3.4) 


220 


(1.7) 


227 1 


(1.5) 


45 minutes 


1992 


54 


[1.2) 


13 1 


(0.5) 


4 ( 2.4) 


10 1 


(0.9) 


4 


(0.9) 


12i 


(0.5) 






208 4 


: 3.1)! 


221 1 


(1.8) 


200 ( 4.4)! 


218 1 


(3.5) 


202 


( 4.6)! 


218 1 


( 1.5) 




1996 


24 


[0.8) 


13 1 


(0.6) 


3(1.0) 


13 1 


(1.2) 


4 


(0.9) 


13 1 


(0.7) 






232 4 


[7.1)! 


225 1 


(1.9) 


••• (•*.•) 


220 1 


(3.0) 


210 


(5.1)! 


225 1 


( 1.5)> 


One hour or more 


1992 


1 4 


;..**) 


15 1 


(0.8) 


1 ( 0.9) 


11 1 


(0.9) 


1 


(0.4) 


12 1 


(0.7) 








...) 


211 1 


(1.4) 


••• (•*,•) 


205 1 


(3.0) 


1 


(••-•) 


205 1 


(1.8) 




1996 


1 ( 0.7) 


12 ( 


(0.7) 


0 (••**) 


12 1 


(1.1) 


2 ( 0.6) 


12 1 


(0.6) 








...) 


217 ( 


(2.3) 




208 1 


(3.7) 


208 ( 5.0)! 


209 1 


(1.9) 



The NAEP mathematics scale ranges hx)m 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for xb& entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. — Does not apply to 
teachers. ! Interpret with caution — the nature of the sample does not allow accurate determination of the variability 
of this statistic. *** Sample size is insufficient to permit a reliable estimate. **** Standard error estimates cannot be 
accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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TABLE 6.8B - GRADE ® 



Public School Teachers* and Students* Reports on Homework 



Approximately how much mathematics 
homework do you assign (time do you 
spend on math homework) each day? 



Colorado 


West 


Nation 


Teacher 


Student 


Teacher 


Student 


Teacher 


Student 



Percentage and Average Scale Score 



1 am not taking mathematics 




























this year. 


1992 


... ( 




0(0.1) 


— I 


(--.■) 


0( 




... j 


[-.-) 


0(0.1) 






... ( 




... ^ 


[“.*) 


— I 


(--.-) 


*“( 


“.*) 


... j 


[-.-) 








1996 


— I 




0(0.1) 


— I 


(-.-) 


0(0.1) 


— ( 


[-.-) 


0 ( 0.0) 






— I 




... , 


rv) 


— I 


(-.-) 


*“( 


“.*) 


... j 


[--.-) 


( 


[“.‘) 


None 


1992 


2 ( 0.7) 


8 1 


(0.6) 


4(1.5) 


9( 


0.8) 


3 ( 0.7) 


8 I 


(0.4) 






... 1 




259 1 


[3.2) 




(“.*) 


256 ( 


4.2) 


233 ( 4.1)1 


254 I 


(2.4) 




1996 


1 ( 0.8) 


6 1 


(0.6) 


2 ( 1.3) 


10 ( 


1.9) 


1 ( 0.5) 


8 I 


(0.8) 






... 1 


rv) 


264 1 


(2.8) 


1 


(“.*) 


261 ( 


: 6.5)1 


1 


(“.‘) 


260 I 


(2.9) 


15 minutes 


1992 


25 


(2.8) 


26 1 


(1.0) 


25 


(2.7) 


22 ( 


1.5) 


29 1 


(2.1) 


27 


(0.8) 






268 < 


(2.7) 


275 1 


(1.7) 


261 


(3.7) 


267 ( 


2.1) 


262 1 


( 1.8) 


269 


(1.4) 




1996 


21 1 


(3.0) 


27 


(1.1) 


30 


(5.3) 


30 ( 


:i.2)> 


32 


(2.7) 


33 


(1.1)> 






267 


(2.6) 


276 1 


(1.6) 


268 


( 5.6)! 


269 ( 


:3.0) 


266 


(2.3) 


273 


(1.2) 


30 minutes 


1992 


53 


(3.1) 


34 1 


(1.1) 


43 


(3.6) 


33( 


:i.o) 


48 


(2.6) 


35 


(0.7) 






272 


(1.7) 


273 


(1.4) 


267 


(3.0) 


270 ( 


:2.3) 


268 


(1.5) 


269 


(1.3) 




1996 


50 


(3.0) 


35 


(1.2) 


49 


(5.1) 


31 { 


[1.2) 


52 


(2.7) 


33 


(0.8) 






272 


(1.6) 


277 


(1.4) 


268 


(3.0) 


271 { 


[2.5) 


274 


(1.9) 


274 


(1.8) 


45 minutes 


1992 


15 


( 2.0) 


17 


(0.8) 


22 


(3.2) 


17 I 


[1.0) 


15 


(2.0) 


16 


(0.6) 






279 


(3.8) 


277 


(1.7) 


278 


(4.8) 


270 1 


[4.3) 


282 


(3.8) 


269 


(1.7) 




1996 


19 


(2.3) 


18 


(1.2) 


13 


(2.4) 


16 1 


(1.2) 


10 


(1.2) 


16 


(0.7) 






287 


(3.2) 


o 

GO 

CM 


(2.1) 


282 


( 7.5)1 


270 1 


(4.3) 


284 


(3,9) 


270 


(2.1) 


One hour or more 


1992 


5 


(1.1) 


14 


(0.9) 


6 


(2.2) 


18 1 


(1.6) 


4 


(0.9) 


13 


(0.7) 






290 


( 4.4)1 


270 


(2.1) 


290 


( 7.9)! 


271 I 


(3.4) 


287 


( 5.3)1 


266 


(2.0) 




1996 


7 


(1.7) 


14 


(0.9) 


5 


(1.0) 


12 I 


( 0.8)< 


5 


(0.8) 


10 


( 0.6)< 






299 


( 4.8)! 


274 


(2.5) 


294 


( 6.4)1 


270 I 


(3.6) 


281 


(3.6) 


267 


(3.1) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent ‘confidence level. — Does not apply to 
teachers. ! Interpret with caution — the nature of the sample does not allow accurate determination of the variability 
of this statistic. *** Sample sire is insufficient to permit a reliable estimate. **** Standard error estimates cannot be 
accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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In addition to being asked about mathematics homework, students were asked how 
often they use a computer at home for schoolwork. The question was not restricted to 
mathematics homework, so students’ reports most likely included homework for other 
academic areas such as English and science. Given that home computers are steadily 
assuming more importance in completing homework assignments,^’ it is important that 
NAEP monitor the prevalence of this practice and its relationship to performance. 

Based on the reports of fourth graders'in Colorado, as shown in Table 6.9A: 

• About one third of the students reported that there was no computer at 
home (35 percent) and another 31 percent reported never or hardly ever 
using their home computer to do homework. 

• About one fifth of the fourth graders reported using their home computer 
to do homework almost every day (7 percent) or once or twice a week 
(13 percent). 

• The average scale score for students who used a computer almost every 
day for homework (220) was lower than that of students who never or 
hardly ever did so (230). 

• The average scale score for students who used a computer almost every 
day for homework did not differ significantly from that of students who 
did not have a computer at home (215). 
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TABLE 6.9A - GRADE 4 


Public School Students^ Reports on Using Computers at 
Home 


State Assessment 



How often do you use a computer at 


Colorado 


West 


Nation 


home for schoolwork? 


Percentage and Average Scale Score 



There is no computer at home. 


35(1.4) 


44 ( 2.6) 


44 ( 1.4) 




-215(1.4) 


210(2.9) 


214 ( 1.3) 


Never or hardly ever 


31 ( 1.2) 


27 ( 1.4) 


26 ( 0.9) 




230 ( 1.5) 


223 ( 2.8) 


229 ( 1.3) 


Once or twice a month 


15 ( 1.0) 


9(1.1) . 


11 (0.6) 




240 ( 1.7) 


236 ( 3.2) 


239 ( 1.6) 


Once or twice a week 


13 ( 0.8) 


11 (1-1) 


10(0.6) 




231(1.5) 


228 ( 4.2) 


228 ( 2.4) 


Almost every day 


7 ( 0.6) 


8 ( 0.6) 


8 ( 0.5) 




220 ( 3.3) 


214(4.2) 


214 ( 2.4) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It cm 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 



National Center for Education Statistics. Digest of Education Statistics 1995. (Washington, DC: National Center for 
Education Statistics, 1995). 
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Colorado 



When eighth-grade public school students in Colorado (see Table 6.9B) were 
asked about the use of home computers to complete homework assignments, they 
reported the following: 

• Less than one third of the students reported that there was no computer 
at home (28 percent) and another 13 percent reported never or hardly 
ever using their home computer to do homework. 

• Less than half of the eighth graders reported using their home computer 
to do homework almost every day (14 percent) or once or twice a week 
(24 percent). 

• The average scale score for students who used a computer almost every 
day for homework (283) was higher than that of students who never or 
hardly ever did so (267). 

• The average scale score for students who used a computer almost every 
day for homework was higher than that of students who did not have a 
computer at home (264). 
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TABLE 6.9B - GRADE 8 


Public School Students* Reports on Using Computers at 
Home 


State Assessment 



How often do you use a computer at 


Colorado 


West 


Nation 


home for schoolwork? 


Percentage and Average Scale Score 



There Is no computer at home. 


28 ( 1.4) 


36 ( 1.9) 


37 ( 1 .2) 




264 ( 1.6) 


261 ( 1.9) 


262 ( 1 .3) 


Never or hardly ever 


13(0.7) 


16(1.1) 


15 (0.8) 




267 ( 2.9) 


266 ( 2.9) 


269 (1.9) 


Once or twice a month 


21 ( 1.0) 


17(1.0) 


19(0.8) 




283 ( 1.8) 


280 ( 3.4) 


282 ( 1.5) 


Once or twice a week 


24 ( 1.2) 


19 ( 1.3) 


17(0.8) 




287 ( 1.6) 


278 ( 3.6) 


282 ( 2.1) 


Almost every day 


14 ( 0.8) 


13(1.1) 


11 (0.6) 




283 ( 2.0) 


280 ( 3.7) 


276 ( 2.7) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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Calculator and Computer Use in the Mathematics 
Classroom 



Recommendations for facilitating mathematics instruction in the nation’s schools 
often include more use of calculators and computers.^® The NCTM Standards recognize 
the technological world in which students are living and the opportunities that 
technology provides for students to learn and use mathematics. The increasingly 
technical workplace demands that students have a deep understanding of mathematics 
that permits solving complex problems. 

Given the importance of using technology in mathematics instruction, NAEP asked 
students and their teachers about their use of calculators and computers. Teachers in 
Colorado were also asked about the availability of computers for mathematics 
instruction. 

Calculators 

Recent analysis of data from the NAEP 1992 assessment suggests a positive 
relationship between calculator use and the effectiveness of the school.” The same 
research also found that the use of calculators in mathematics classes varied widely from 
school to school As part of the NAEP assessment, students and their mathematics 
teachers were asked to report on the frequency of use of calculators in mathematics 
classes and teachers were asked about the use of calculators on tests. This latter question 
is relevant to NAEP since the students are allowed to use a calculator on a portion of 
the assessment. (The question concerning calculator use on tests was not asked of 
students.) Reports from public school teachers of the fourth graders in Colorado (shown 
in Tables 6.10A and 6.11 A) indicate the following: 

e About one third of the students used a calculator in their mathematics 
class almost every day (5 percent) or once or twice a week (29 percent). 
About one fifth of the students never or hardly ever used a calculator 
(22 percent). The percentage of students using a calculator almost 
every day did not differ significantly from that for the nation 
(5 percent). 

• Teachers of 14 percent of fourth graders reported permitting students to 
use calculators for tests. The average scale score for students who were 
allowed to use calculators (226) was not significantly different from that 
of students who were not (226). 

• The percentage of students in 1996 who were permitted to use 
calculators on tests was not significantly different from that in 1992 
(9 percent). 

When fourth graders were asked about the use of calculators in their mathematics 
class, their responses (as shown in Table 6.10A) indicated the following: 

• About one third of the students reported using a calculator almost every 
day (8 percent) or once or twice a week (24 percent). In comparison, 

38 percent of students reported never or hardly ever using calculators 
in their mathematics class. 



National Council of Teachers of Mathematics. Curriculum and Evaluation Standards for School Mathematics. (Reston, 
VA: NCTM, 1989). 

” Mullis, I.V.S., F. Jenkins, and E.G. Johnson. Effective Schools in Mathematics. (Washington, DC: U.S. Department 
of Education, 1994). 
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TABLE 6.1 OA - GRADE 4 


Public School Teachers’ and Students’ Reports on the 
Frequency of Calculator Use 


state Assessment 



How often do the students in this 
ciass (do you) use a caicuiator? 


Colorado 


West 


Nation 


Teacher 


Student 


Teacher 


Student 


Teacher 


Student 


Percentage and Average Scale Score 



Never or hardly ever 


22 1 


(2.8) 


38 1 


(1.9) 


27 


(4.4) 


46 1 


(2.2) 


24 ( 


(2.5) 


40 1 


(1.4) 




220 1 


(2.4) 


224 1 


(1.6) 


219 


(3.4) 


217 ( 


(2.6) 


216 1 


(2.3) 


220 1 


(1.3) 


Once or twice a month 


44 1 


(2.9) 


30 1 


(1.2) 


41 


(3.6) 


25 ( 


(1.1) 


42 ( 


(2.6) 


26 1 


(0.8) 




225 1 


( 1.9) 


233 1 


(1.5) 


221 


(2.7) 


230 1 


(1.8) 


223 1 


(1.6) 


233 1 


(1.0) 


Once or twice a week 


29 1 


(2.8) 


24 ( 


(1.4) 


28 


(4.4) 


20 1 


(1.3) 


29 1 


(2.4) 


23 1 


(1.0) 




232 ( 


(1.7) 


226 1 


(1.5) 


220 


(3.6) 


221 < 


(2.6) 


229 { 


: 1.8) 


223 1 


(1.4) 


Almost every day 


5 ( 


(1.4) 


8 1 


(0.8) 


4 


(1.6) 


91 


: 1.0) 


5 { 


(0.9) 


11 1 


(0.6) 




227 ( 


[ 5.5)! 


210 1 


(2.7) 




(**.*) 


199 { 


(3.6) 


227 { 


(5.0) 


206 1 


(1.9) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of ^e variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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TABLE 6.11 A - GRADE 4 


Public School Teachers ’ Reports on the Use of Calculators 
for Tests 



Do you permit students in this ciass to 


Colorado 


West 


Nation 


use caicuiators for tests? 


Percentage and Average Scale Score 



Yes 


1992 


9 1 


(2.2) 


6 


(1.9) 


5 ( 


(1.2) 






228 1 


( 2.9)1 


*** 


r*.*) 


228 1 


( 4.3)1 




1996 


14( 


(2.6) 


9 


(3.0) 


10( 


(1.8) 






226 1 


(4.3) 


219 


( 6.7)! 


222 1 


(2.4) 


No 


1992 


91 ( 


(2.2) 


94 


(1.9) 


95 1 


(1.2) 






221 1 


(1.2) 


218 


(2.0) 


218 1 


(1.0) 




1996 


86 1 


(2.6) 


91 


(3.0) 


90 1 


(1.8) 






226 1 


(1.2)> 


220 


(2.2) 


223 1 


(1.2)> 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher Oower) than the value for 1992 at alx)ut the 95 percent confidence level. ! Interpret with caution 
— the nature of the sample does not allow accurate determination of the variability of this statistic. *** Sample size is 
insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Colorado 



Eighth-grade students and their mathematics teachers were asked the same 
questions about calculator use, and the results are shown in Tables 6.1 OB and 6.1 IB. 
Based on the responses of eighth-grade public school teachers in Colorado, results 
showed that: 

• About three quarters of the students used a calculator in their 
mathematics class almost every day (56 percent) or once or twice a 
week (24 percent). Relatively few of the students never or hardly ever 
used a calculator (9 percent). The percentage of students using a 
calculator almost every day did not differ significantly from that for the 
nation (57 percent). 

• In 1996, when asked if they allowed students to use a calculator for tests, 
teachers of 68 percent of eighth graders reported permitting students to 
use them. The average scale score for students allowed to use 
calculators (278) was higher than that of students who were not (270). 

• The percentage of students in 1996 who were permitted to use a 
calculator on tests was not significantly different from the percentage in 
1992 (65 percent) and larger than the percentage in 1990 (45 percent). 

Responses from eighth-grade students (Table 6.10B) showed the following: 

• About three quarters of the students reported using a calculator almost 
every day (52 percent) or once or twice a week (26 percent). In 
comparison, 10 percent of students reported never or hardly ever using 
a calculator in their mathematics class. 
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TABLE 6.1 OB — GRADE 8 


Public School Teachers* and Students* Reports on the 
Frequency of Calculator Use 


How often do the students in this 
ciass (do you) use a caicuiator? 


Colorado 


West 


Nation 


Teacher Student 


Teacher Student 


Teacher Student 


Percentage and Average Scale Score 



Never or hardly ever 


9 ( 2.7) 


10 (1.3) 


8(1.9) 


11 (1.7) 


0(1.5) 


11 ( 1.1) 




272 ( 3.6)1 


266 ( 3.0) 


260 ( 7.9)1 


256(5.1) 


251 ( 5.0) 


254 ( 2.7) 


Once or twice a month 


11 ( 2.0) 


11 (1.1) 


15 (3.3) 


13(1.1) 


15 ( 2.3) 


13 ( 0.9) 




258 ( 2.9)1 


270 ( 2.9) 


256 ( 7.7)1 


262 ( 3.9) 


260 ( 3.3) 


265 ( 2.0) 


Once or twice a week 


24 ( 2.8) 


26 ( 1.6) 


22 ( 3.9) 


27(1.1) 


20 ( 2.6) 


27(1.4) 




274 ( 2.7) 


276 ( 1.7) 


263 ( 3.0)! 


263 ( 2.0) 


269 ( 3.5) 


267 ( 1 .5) 


Almost every day 


56 ( 3.6) 


52 ( 2.4) 


55 ( 4.4) 


40 ( 3.2) 


57 ( 3.0) 


49 ( 2.5) 




201 (2.1) 


279 ( 1.6) 


280 ( 2.9) 


277 ( 2.9) 


200 ( 1.7) 


270 ( 1 .6) 



- . “ . "T — t,-'' w The standard errors of the statistics appear in parentheses. It can 

said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standarf errors of the esdmate for the sample. In comparing two estimates, one must use the standard error of the 
^fference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the vanability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress fNAEP> 1996 

Mathematics Assessment. ^ 
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TABLE S.1ie — GRADE 



Public School Teachers* Reports on the Use of Calculators 
for Tests 



Do you permit students in this dess to 
use caicuiatora for tests? 


Colorado 


West 


Nation 


Percentage and Average Scale Score 


Yea 


1990 


45 ( 2.9) 


40 ( 0.0) 


33 ( 4.5) 






273 ( 1.4) 


273 ( 4.7)1 


271 ( 2.9) 




1992 


65(3.1)** 


53 ( 5.4) 


49(3.1)** 






276 ( 1.4) 


272 ( 2.0) 


275 ( 1.9) 




1996 


60 ( 3.6)** 


61 (6.1) 


70 ( 3.0)*»> 






270 ( 1.7) 


270 ( 2.7) 


279 ( 1.6) 


No 


1990 


55 ( 2.9) 


52 ( 0.0) 


67 ( 4.5) 






262 ( 1.4) 


255 ( 3.4) 


250 ( 1 .0) 




1992 


35(3.1)« 


47 ( 5.4) 


51 ( 3.1)« 






264 (1.6) 


263 ( 3.0) 


262 ( 1 .6) 




1996 


32 ( 3.6)« 


39 ( 6.1) 


30 ( 3.0)«< 






270 ( 2.4)** 


260 ( 4.6) 


259 ( 2.3) 



rmigcs Iium u lo juu. me Standard errors ot the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± l standard errors of Ae estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation » («) appears, it signifies that the value for public school students 
was significMUy higher (lower) than the value for 1990 at about the 95 percent confidence level. If the notation > (<) 
appears, it sigmfies that the value for public school students was significantly higher (lower) than the value for 1992 at 
about \ht 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
detenmnation of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP) 1990 1992 
and 1996 Mathematics Assessments. c v y. . , 
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Computers 

Computers are potentially valuable instructional tools for the mathematics 
classroom and can be used to demonstrate mathematics concepts, diagnose learning 
problems, deliver instruction, and analyze data. Computers are increasingly important 
in students’ homes, where they are used for homework as well as for other pursuits. 
Since 1984, the percentage of students in grades 7 through 12 who use a computer at 
school or at home has increased.*” 

Teachers of the students assessed were asked about the availability and 
accessibility of computers for use in their mathematics classroom. Based on the 
responses of fourth-grade teachers, the results are shown in Table 6.12A. 

• In Colorado, 4 percent of students had teachers who reported that no 
computers were available for use in their mathematics class and 
1 8 percent had teachers who reported that computers were available in 
a computer laboratory but difficult to access or schedule. In comparison, 

7 percent of students were in mathematics classes where four or more 
computers were available within the classroom and 18 percent where 
computers were available in a laboratory and easy to access or schedule. 

» The percentage of students in mathematics classes where computers 
were not available was not significantly different from the percentage 
for the nation (6 percent). 
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TABLE 6.1 2A - GRADE 4 



Public School Teachers* Reports on the Availability of 
Computers 



Which best describes the evelleblllty of 


Colorado 


West 


Nation 


computers for use by students In your 
methemetics classes? 


Percentage and Average Scale Score 




None eveiiable 


4(1.1) 
216 (3.3)t 


6 ( 2.3) 
228 ( 5.7)1 


6(1.3) 
218 (4.0)1 


One whhin the classroom 


31 ( 3.3) 
227 ( 2.2) 


37 ( 4.4) 
216(2.6) 


35 ( 3.3) 
225 ( 1.7) 


Two or three whhin the classroom 


22(3.1) 
225 ( 2.6) 


21 ( 4.4) 
218(4.4)1 


22 ( 2.2) 
222(2.1) 


Four or more whhin the classroom 


7 ( 2.4) 
231 ( 4.9)1 


5 (1.7) 


7(1.5) 
224 ( 7.5)1 


Available in a computer laboratory but 
dhficuh to access or schedule 


18(3.1) 
223 ( 2.6) 


13(3.3) 
226 (10.2)1 


13 ( 1.9) 
222 ( 4.5) 


Available in a computer laboratory and 
easy to access or schedule 


18(2.6) 
227 ( 3.0) 


18 ( 3.7) 
223 ( 2.6)t . 


16(2.7) 
224 ( 2.0) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It c^ 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 



^ National Center for Education Statistics. Digest of Education Statistics 1995. (Washington, DC: National Center for 
Education Statistics, 1995). 
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As presented in Table 6.12B, when eighth-grade mathematics teachers were asked 
about availability of computers, their responses indicated the following: 

o In Colorado, 12 percent of the students had teachers who reported that 
no computers were available for use in their mathematics classes and 
41 percent had teachers who reported computers were available in a 
computer laboratory but difficult to access or schedule. In comparison, 

2 percent of the students were in mathematics classes where four or 
more computers were available within the classroom and 19 percent 
where computers were available in a laboratory and easy to access or 
schedule. 

o The percentage of students in mathematics classes where computers 
were not available was smaller than the percentage for the nation 
(26 percent). 
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TABLE 6.1 2B - GRADE 8 


Public School Teachers’ Reports on the Availability of 
Computers 




Which best describes the availability of 
computers for use by students in your 
mathematics classes? 


Colorado West Nation 


Percentage and Average Scale Score 



None available 


12 (1.9) 


27 ( 4.4) 


26 ( 3.7) 




278 ( 3.4) 


266(5.3) 


269(3.1) 


One within the classroom 


19(2.8) 


13 ( 3.2) 


19(3.0) 




279 ( 2.8) 


275 ( 5.3)l 


271 ( 3.9) 


Two or three within the classroom 


6 ( 2.3) 


3( 1.3) 


5(1.5) 




270 ( 4.2)l 


(“.*) 


274 (10.2)1 


Four or more within the classroom 


2(1.0) 


12(5.1) 


7(2.1) 


Available in a computer laboratory but 


*** (**.*) 


275 ( 3.2)1 


274 ( 4.4)1 


difficult to access or schedule 


41 (4.1) 


24 ( 3.4) 


26 ( 3.6) 


Available in a computer laboratory and 


278 ( 2.4) 


265 ( 6.2) 


270 ( 2.6) 


easy to access or schedule 


19(3.3) 


21 ( 5.3) 


18 (2.8) 




270 ( 3.8) 


276 ( 8.0)1 


278 ( 4.1) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
i 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 

SOURCE; National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 
Mathematics Assessment. 



133 



o 

ERIC 



138 



THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



Colorado 



In addition to a range of availability from school to school, the uses of computers 
can vary widely from class to class. There are a variety of ways that computers can be 
used to help students learn and use mathematics, such as exploring new mathematical 
ideas, analyzing information to solve problems, practicing skills, and playing 
mathematical games. Also, the frequency of use can vary regardless of the primary use 
of the computers in the classroom. Teachers in Colorado were asked how they used 
computers and how often they were used in their mathematics classroom. The responses 
of fourth-grade public school teachers, shown in Table 6.13A, indicate the following: 

• About one fifth of the fourth graders had teachers who reported not using 
a computer for mathematics instruction (20 percent). This percentage 
did not differ significantly from the percentage for the nation 
(23 percent). 

• In Colorado, 16 percent of students had teachers who reported never or 
hardly ever using a computer with their classes, compared to more than 
half who reported doing so almost every day (7 percent) or once or 
twice a week (51 percent). 
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TABLE 6.1 3A — GRADE 4 


Public School Teachers’ Reports on the Primary Use and 


State Assessment 


Frequency of Use of Computers 



Colorado 


West 


Nation 


Percentage and Average Scale Score 



if you do use computers, what is the 








primary use of these computers for 








mathematics instruction? 








Drill and practice 


34 ( 3.0) 


28 ( 3.6) 


27 ( 2.4) 




228 ( 1.9) 


219 ( 3.0) 


222(2.1) 


Demonatration of new topics in mathematics 


3( 1.6) 


0 (**•*) 


2 ( 0.6) 




*** 


*** j** 


222 ( 7.5)l 


Playing mathematical/leaming games 


37 ( 3.0) 


42 ( 4.3) 


41 ( 2.6) 




227 ( 1.9) 


220 ( 2.5) 


225 ( 1.5) 


Simulations and applications 


5(1.5) 


6(1.2) 


6( 1.2) 




224 ( 4.6)1 


217(6.2)1 


225 ( 3.6) 


I do not use computera for Instruction. 


20 ( 3.2) 


24 ( 5.5) 


23 ( 2.9) 




227 ( 2.6) 


219(7.7)1 


220 ( 3.4) 


How often do the students in this ciaaa 








use a computer? 








Never or hardly ever 


16 ( 2.5) 


20 ( 3.5) 


21 ( 2.4) 




226 ( 2.8) 


216(6.0) 


221 ( 2.6) 


Once or twice a month 


26 ( 2.8) 


17(2.3) 


19 ( 1.9) 




226 ( 1.8) 


220 ( 2.5) 


227(2.1) 


Once or twice a week 


51 ( 3.4) 


56 ( 3.8) 


46 ( 2.5) 




226 ( 1 .7) 


221 ( 2.2) 


222 ( 1.4) 


Almost every day 


7(1.5) 


7(1.8) 


14(1.8) 




225 (4.1)1 


221 (5.1)1 


225 ( 2.8) 



The NAEP mathematics scale ranges from 0 to 500. The standaid errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
detennmation of the variabiUty of this statistic. Sample size is insufficient to permit a reUable estimate. 

**** Standard error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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Table 6.13B presents the eighth-grade teachers’ reports on uses for computers in 
their mathematics classrooms. 

• About half of the eighth graders had teachers who reported not using a 
computer for mathematics instruction (48 percent). This percentage did 
not differ significantly from the percentage for the nation (52 percent). 

• In Colorado, 71 percent of students had teachers who reported never or 
hardly ever using a computer with their classes, compared to a small 
percentage who reported doing so almost every day (1 percent) or once 
or twice a week (3 percent). 
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TABLE 6.1 3B - GRADE 8 



Public School Teachers’ Reports on the Primary Use and 
Frequency of Use of Computers 





Colorado 


West 


Nation 


Percentage and Average Scale Score 








If you do use computers, whet Is the 








primsry use of these computers for 








mathematics Instruction? 








Drill and practice 


15(2.9) 


22 ( 6.7) 


18 (2.5) 




271 ( 4.0)1 


275 ( 7.9)! 


270 ( 4.3) 


Demonatratlon of new topica In mathematlea 


6(1.6) 


5 (•-•) 


5(1.5) 




263 ( 5.7)1 


- CV) 


280 ( 3.6)l 


Playing mathamatical/leaming games 


17(2.7) 


13(3.7) 


13(2.4) 




276 ( 3.7) 


275 ( 6.7)1 


266 ( 4.3) 


SImulatlona and appllcatlona 


15(2.7) 


10(3.5) 


13(2.9) 




276 ( 4.2) 


266 ( 5.4)1 


281 ( 4.5)E 


1 do not use computara for Inatructlon. 


48 ( 3.4) 


50 ( 5.5) 


52 ( 3.9) 




. 275( 1.7) 


267 ( 2.7) 


270 ( ’l .5) 


How often do the atudenta In thia class 








use a computer? 








Never or hardly ever 


71 ( 3.7) 


69(5.6) 


70 ( 3.9) 




276 ( 1.4) 


271 ( 2.7) 


273 ( 1.4) 


Once or twice a month 


26 ( 3.6) 


21 ( 5.3) 


22 ( 3.9) 




276 ( 3.6) 


278 ( 7.8)1 


277 ( 3.9) 


Once or twice a week 


3 ( 0.7) 


9 ( 3.6) 


8(1.5) 




271 (10.1)1 


255 ( 6.5)1 


262 ( 5.5) 


Almost every day 


1 rn 


1 ( 0.6) 


1 ( 0.4) 




-r.*) 


*** 


250 ( 8.6)l 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentl^ses. It c^ 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
**** Standard error estimates caxmot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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Finally, students were asked how often they used computers when doing 
mathematics in school. The question was not limited to using the computer in their 
mathematics class. Therefore, students’ responses could include use of computers to 
do mathematics assignments at other times throughout the school day or in before/after 
school programs. On the basis of the responses of fourth-grade public school students, 
as shown in Table 6.14A, results indicated that: 

o In Colorado, 58 percent of students never or hardly ever used computers 
to do mathematics in school. Less than one third of the fourth graders 
used computers for this purpose almost every day (10 percent) or once 
or twice a week (20 percent). 
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TABLE 6.1 4A — GRADE 4 


Public School Students’ Reports on the Frequency of 
Computer Use 


state Assessment 



When you do mathematics in school. 


Colorado 


West 


Nation 


how often do you use a computer? 


Percentage and Average Scale Score 



Never or hardly ever 


58 ( 1.3) 


56 ( 1.7) 


56 ( 1 .0) 




225 ( 1.3) 


217(2.4) 


223 ( 1 .2) 


Once or twice a month 


13(0.7) 


10(1.1) 


10 ( 0.7) 




233(2.1) 


220 ( 4.7) 


226 ( 2.4) 


Once or twice a week 


20 ( 0.9) 


22 ( 1.6) 


20 (1.0) 




227 ( 1.5) 


226 ( 2.6) 


225 ( 1.3) 


Almost every day 


10(0.7) 


11 ( 0.9) 


14(0.8) 




223 ( 2.4) 


216(2.7) 


218(1.8) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence tlmt, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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Table 6.14B presents results for eighth-grade public school students who were 
asked the same question. 

• In Colorado, 58 percent of students never or hardly ever used computers 
to do mathematics in school. About one quarter of the eighth graders 
used computers for this purpose almost every day (12 percent) or once 
or twice a week (12 percent). 
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TABLE 6.1 4B - GRADE 8 


Public School Students^ Reports on the Frequency of 
Computer Use 


State Assessment 



When you do mathematics in school, 


Colorado 


West 


Nation 


how often do you use a computer? 


Percentage and Average Scale Score 



Never or hardly ever 


50 ( 1 .4) 
273 ( 1.3) 


56 ( 2.6) 
266 ( 2.0) 


57 ( 1-4) 
270 ( 1 .3) 


Once or twice a month 


10(1.1) 
270 ( 2.1) 


17 ( 1.3) 
275 ( 4.6) 


16(0.9) 
275 ( 2.2) 


Once or twice a week 


12 ( 0.6) 
200 ( 2.3) 


15 ( 1.5) 
266 ( 4.9) 


15 ( 0.9) 
270 ( 2.0) 


Almost every day 


12 ( 0.9) 
202 ( 2.2) 


13 ( 1.1) 
269 ( 3.9) 


12 ( 0.6) 
270 ( 2.2) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In con^aring two estimates, one must use the standard error of the 
difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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CHAPTER 7 



Influences Beyond School That Facilitate 
Learning Mathematics 

The home environment can be an important support for the school environment. 
To examine the relationship between mathematics scale scores and home factors, the 
NAEP assessment considered students’ responses to questions about home factors and 
principals’ responses to questions about parental involvement in the school. To examine 
the impact of student mobility on academic achievement, students were also asked how 
often they had changed schools because of household moves. 

The students’ attitudes toward mathematics can also be expected to relate to their 
performance in the assessment. As the NCTM Curriculum and Evaluation Standards 
for School Mathematics warns, the beliefs that students develop influence not only their 
thinking and performance but also their attitude and decisions about studying 
mathematics in future years. The NCTM Standards describes specific attitudes that 
should be given increased attention in the curriculum. 

Discussing Studies at Home 

When students discuss academic work at home, they create an important link 
between home and school. How often schoolwork is discussed at home can be a 
measure of the importance of school for students and their families. Recent NAEP 
assessments in a variety of subject areas have found a positive relationship between 
discussing studies at home and student performance.^' 
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Campbell, J.R., P.L. Donahue, C.M. Reese, and G.W. Phillips. NAEP 1994 Reading Report Card for the Nation and 
the States. (Washington, DC: National Center for Education Statistics, 1996); Beatty, A.S., C.M. Reese, H.R. Persky, 
and P. Carr. NAEP 1994 U.S. History Report Card. (Washington, DC: National Center for Education Statistics, 1996); 
Persky, H.R., C.M. Reese, C.Y. O'Sullivan, S. Lazer, J. Moore, and S. Shakrani. NAEP 1994 Geography Report Card. 
(Washington, DC: National Center for Education Statistics, 1996). 
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Students were asked to report on the frequency of home discussion about 
schoolwork. As shown in Table 7.1A, the 1996 results for fourth graders attending 
public schools in Colorado indicate that 

• More than half of the fourth graders (58 percent) said they discussed 
their schoolwork at home almost every day. This percentage was larger 
than the percentage who said they never or hardly ever had such 
discussions (13 percent). 

• The average scale score for students who discussed their schoolwork 
almost every day (228) was higher than that for students who never or 
hardly ever did so (217). 
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TABLE 7.1A-GRADE4 



Public School Students’ Reports on Discussing Studies at 
Home 



Colorado 


West 


Nation 


Percentage and Average Scale Score 



How often do you discuss things you 
have studied in schooi with someone 
at home? 



Never or hardly ever 


1992 


18 1 


[0.7) 


20 1 


[1.1) 


20 i 


(0.6) 






CO 

o 

CM 


[1.6) 


207 ( 


[1.9) 


209 1 


(1.2) 




1996 


13 ( 


[ 0.9)< 


20 1 


(1.2) 


17( 


( 0.6)< 






217 ( 


[ 2.0)> 


210 1 


(2.7) 


213 1 


(1.4) 


Once or twice a month 


1992 


5( 


[0.4) 


71 


(0.6) 


6 1 


(0.3) 






220 1 


[2.5) 


224 1 


(5.2) 


220 1 


(2.9) 




1996 


5( 


[0.4) 


61 


(0.9) 


51 


(0.3) 






227 ( 


[3.6) 


2261 


(5.4) 


226 1 


(2.8) 


Once or twice a week 


1992 


21 ( 


[0.8) 


20 1 


(1.1) 


21 1 


(0.6) 






225 1 


[1.7) 


222 1 


(1.7) 


225 1 


(1.1) 




1996 


24 ( 


[1.0) 


21 1 


(1.2) 


22 1 


(0.7) 






225 1 


(1.7) 


222 1 


(3.1) 


227 1 


(1.4) 


Almost every day 


1992 


55 1 


[1.0) 


53 1 


(1.4) 


53 1 


(0.7) 






224 1 


[1.0) 


220 1 


(1.6) 


220 1 


(0.9) 




1996 


58 1 


(1.3) 


53 1 


(1.6) 


56 1 


(0.9) 






228 1 


[1.2)> 


219 1 


(2.9) 


223 1 


(1.3) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than die value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Based on the reports of eighth graders, Table 7. IB indicates the following 
relationship between discussing studies at home and mathematics performance on the 
NAEP 1996 assessment, 

• In Colorado, less than half of the eighth-grade students (44 percent) said 
they discussed their schoolwork at home almost every day. This 
percentage was larger than the percentage who said they never or hardly 
ever had such discussions (16 percent). 

• The average scale score for students who discussed their schoolwork 
almost every day (279) was higher than that for students who never or 
hardly ever did so (267). 
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TABLE 7.1 B - GRADE 8 


Public School Students^ Reports on Discussing Studies at 
Home 


State Assessment 



How often do you discuss things you 
have studied in school with someone 
at home? 



Colorado 


West 


Nation 


Percentage and Average Scale Score 



Never or hardly ever 


1992 


18 ( 


:o.8) 


21 { 


(1.2) 


23 1 


10.6) 






264 ( 


:i-7) 


255 1 


(2.6) 


257 ( 


[1.2) 




1996 


16 i 


:o.8) 


21 ( 


(1.4) 


21 ( 


[1.0) 






267 ( 


[2.0) 


260 1 


(3.1) 


263 1 


1 1.8)> 


Once or twice a month 


1992 


8( 


:o.5) 


9( 


(0.6) 


10 ( 


10.4) 






267 ( 


:2.8) 


266 1 


(3.5) 


267 ( 


11.8) 




1996 


10( 


:o.7) 


9 1 


(0.6) 


10 ( 


10.4) 






275 ( 


:2.4) 


267 1 


(3.7) 


271 1 


(2.6) 


Once or twice a week 


1992 


28 ( 


:o.9) 


28 1 


(1.5) 


28 1 


(0.6) 






276 ( 


:i-4) 


272 ( 


(2.6) 


271 1 


(1.1) 




1996 


30 ( 


:o.9) 


28 1 


(0.9) 


29 1 


(0.8) 






278 ( 


:i-5) 


271 ( 


(3.0) 


275 1 


(1.5) 


Almost every day 


1992 


46 ( 


:i.i) 


41 ( 


(2.1) 


39 1 


(0.9) 






276 ( 


(1.2) 


274 ( 


(2.4) 


272 1 


(1.5) 




1996 


44 1 


(1.1) 


42 ( 


(1.3) 


40 1 


(1.0) 






279 ( 


(1.3) 


274 ( 


(2.2) 


274 1 


(1.2) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Literacy Materials in the Home 

Students can leam much about mathematics and its role in real-world situations 
by reading materials outside the classroom. Research findings and results from opinion 
polls are often found in magazine and newspaper articles. Also, the availability of 
reading and reference materials at home may be an indicator of the value placed by 
parents on leaming.^^ In past NAEP assessments, a positive relationship has consistently 
been reported between print materials in the home and average scale scores.^^ 

As part of the NAEP assessment, students were asked whether their families have 
more than 25 books, an encyclopedia, receive a newspaper regularly, and receive any 
magazines regularly. Table 7.2A shows the percentages of fourth-grade public school 
students reporting that their families have all four types, only three types, or two or fewer 
types of these literacy materials and students’ average scale scores. Based on their 
responses: 

• Less than half of the students in Colorado (39 percent) reported having 
all four types of literacy materials in their homes. This percentage was 
somewhat greater than the percentage for the nation (34 percent). 

• In comparison, the percentage reporting having two or fewer types of 
these materials (29 percent) was smaller than the percentage having all 
four types. The percentage having two or fewer types was somewhat 
smaller than the percentage for the nation (32 percent). 

• In 1996 the average mathematics scale score for students with all four 
types of literacy materials (236) was higher than that for students with 
two or fewer types (214). 



Rogoff, B. Apprenticeship in Thinking: Cognitive Development in Social Context. (New York: Oxford University Press, 
1990). 

^ Campbell, J.R., P.L. Donahue, C.M. Reese, and G.W. Phillips. NAEP 1994 Reading Report Card for the Nation and 
the States. (Washington, £>C: National Center for Education Statistics, 1996); Beatty, A.S., C.M. Reese, H.R. Persky, 
and P. Carr. NAEP 1994 U.S. History Report Card. (Washington, DC: National Center for Education Statistics, 1996); 
Persky, H.R., C.M. Reese, C.Y. O'Sullivan, S. Lazer, J. Moore, and S. Shakrani. NAEP 1994 Geography Report Card. 
(Washington, DC: National Center for Education Statistics, 19%). 
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TABLE 7.2A - GRADE 4 


Public School Students* Reports on Literacy Materials in the 
Home 




How many of the following types of 
reading materials are in your home 
(more than 25 books, an encyclopedia, 
a newspaper, magazines)? 


Colorado West Nation 


Percentage and Average Scale Score 



Zero to two 


1992 


29 1 


(1.2) 


33 


(2.4) 


31 1 


(1.3) 






2101 


(1.4) 


210 1 


(1.7) 


208 1 


(1.1) 




1996 


29 1 


(1.4) 


38 1 


(1.8) 


32 1 


(0.9) 






214 1 


(1.4) 


208 1 


(3.5) 


212 1 


(1.7) 


Three 


1992 


34( 


(1.0) 


34( 


(1.1) 


35 1 


(0.7) 






222 ( 


(1-3) 


220 ( 


[ 1.8) 


220 1 


(1.0) 




1996 


32 ( 


(1.0) 


32 ( 


(1.0) 


341 


(0.7) 






226 < 


:i.3) 


221 ( 


(2.2) 


224 ( 


[1.2)> 


Four 


1992 


37 ( 


:i-i) 


32 i 


:2.3) 


34( 


(1.2) 






229 < 


:i.3)- 


227 ( 


:2.5) 


228 ( 


:i.2) 




1996 


39 ( 


1-5) 


30 ( 


: 1.6) 


34( 


:o.9) 






236 ( 


1.4)> 


228 ( 


2.9) 


231 ( 


1.3) 



TTie NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of Ae estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Table 7.2B shows the results based on eighth-grade public school students’ reports 
on literacy materials in the home and their average scale scores. 

® About half of the eighth graders in Colorado (52 percent) reported 
having all four types of literacy materials in their homes. This 
percentage was somewhat greater than the percentage for the nation 
(47 percent). 

o In comparison, the percentage reporting having two or fewer types of 
these materials (18 percent) was smaller than the percentage having all 
four types. The percentage having two or fewer types was somewhat 
smaller than the percentage for the nation (21 percent). 

® Based on the 1996 results for Colorado, the average mathematics scale 
score for students with all four types of literacy materials (284) was 
higher than that for students with two or fewer types (258). 
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TABLE 7.2B - GRADE 8 


Public School Students* Reports on Literacy Materials in the 
Home 


state Assessment 



How many of the following types of 
reading materials are in your home 
(more than 25 books, an encyclopedia, 
a newspaper, magazines)? 



Colorado 


West 


Nation 


Percentage and Average Scale Score 



Zero to two 


1990 


15 ( 


0.7) 


24 < 


;i-6) 


21 ( 


;i.o) 






249 ( 


1-6) 


244 ( 


;4.3) 


244 ( 


;2.i) 




1992 


17( 


0.9) 


25 < 


:i-6) 


21 ( 


:o.7) 






253 < 


;i.8) 


250 < 


;2.3) 


246 ( 


;i.2) 




1996 


18 I 


:i.i) 


27 ( 


;i.7) 


21 ( 


(0.7) 






256 < 


;i.9)»> 


254 < 


:2.8) 


254 < 


(1.6)»> 


Three 


1990 


32 { 


:o.8) 


31 { 


;i.4) 


30 < 


(1.0) 






264 { 


:i-4) 


257 ( 


( 2.3) 


259 < 


(1.6) 




1992 


32 { 


:o.9) 


31 ( 


(1.6) 


31 ( 


(0.7) 






271 { 


[^Ah 


270 ( 


[ 2.4)« 


266 1 


(1.3). 




1996 


30 1 


(1.0) 


32 1 


(1.7) 


31 ( 


(0.9) 






272 ( 


(1.6)- 


266 1 


(2.1). 


2661 


(1.2). 


Four 


1990 


53 1 


(1.0) 


45 1 


(1.9) 


46 1 


(1.3) 






275 1 


(0.9) 


273 1 


(3.1) 


2721 


(1.5) 




1992 


51 1 


( 1 . 1 ) 


44 1 


(1.8) 


46 1 


(1.0) 






260 1 


(1.0)« 


277 1 


(2.0) 


276 1 


( 1 . 1 ) 




1996 


52 


( 1 . 5 ) 


41 1 


(2.5) 


47 1 


( 1 . 1 ) 






264 


( 1 . 2 ). 


279 


(2.4) 


261 


( 1.4)»> 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation » («) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1990 at about the 95 percent confidence level. If the notation > (<) 
appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 at 
about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990, 1992, 
and 1996 Mathematics Assessments. 
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Television Viewing Habits 

Past NAEP assessments have shown that over 40 percent of fourth- and 
eighth-grade students reported watching four or more hours of television each day. A 
major concern is that time spent watching television results in less time available for 
homework and related academic activities. The effects of such extensive television 
exposure are difficult to document, but there is a generally negative relationship between 
NAEP score results and hours watched.^ 

Students were asked how much television they usually watched each day. The 
results for fourth- and eighth-grade public school students in Colorado are shown in 
Tables 7.3A and 7.3B, respectively. 

• Among fourth graders, 1 1 percent reported watching six or more hours 
of television on a typical day. This percentage was smaller than the 
percentage who reported watching one hour or less (33 percent). 

• The percentage of fourth graders in Colorado who reported watching six 
or more hours of television a day was smaller than the percentage for 
the nation (20 percent). 

• Based on the 1996 state results, the average mathematics scale score for 
fourth-grade students who reported watching two to three hours of 
television a day (229) was not significantly different from that for 
students who reported watching one hour or less (228). 

• The average scale score for fourth graders who reported watching two 
to three hours of television a day was higher than that for students who 
reported watching six hours or more (212). 

o Among eighth graders, 9 percent reported watching six or more hours 
of television on a typical day. This percentage was smaller than the 
percentage who reported watching one hour or less (21 percent). 

• The percentage of eighth graders in Colorado who reported watching six 
or more hours of television a day was smaller than the percentage for 
the nation (14 percent). 

• Based on the 1996 state results, the average mathematics scale score for 
eighth-grade students who reported watching two to three hours of 
television a day (279) was not significantly different from that for 
students who reported watching one hour or less (284). 

• The average scale score for eighth graders who reported watching two 
to three hours of television a day was higher than that for students who 
reported watching six hours or more (254). 



Campbell, J.R., P.L. Donahue, C.M. Reese, and GW. Phillips. NAEP 1994 Reading Report Card for the Nation and 
the States. (Washington, DC: National Center for Education Statistics, 1996); Beatty, A.S., C.M. Reese, H.R. Persky, 
and P. Carr. NAEP 1994 U.S. History Report Card. (Washington, DC: National Center for Education Statistics, 1996); 
Persky, H.R., C.M. Reese, C.Y. O’Sullivan, S. Lazer, J. Moore, and S. Shakrani. NAEP 1994 Geography Report Card. 
(Washington, DC: National Center for Education Statistics, 1996). 
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TABLE 7.3A - GRADE 4 


Public School Students* Reports on Television Viewing Habits 


Stats Assessment 



How much television do you usually 


Colorado 


West 


Nation 


watch each day? 


Percentage and Average Scale Score 



1 hour or less 


1992 


27 1 


:o.9) 




26 1 


[1.5) 


21 ( 


(0.8) 






2231 


:i.3) 




221 1 


12.4) 


221 1 


[ 1.6) 




1996 


331 


:i.4)> 




281 


[2.4) 


24 4 


[1.1) 






2281 


:i.5) 




2181 


[3.9) 


2231 


[ 1.8) 


2 to 3 hours 


1992 


391 


:i.o) 




33 1 


;i.6) 


35 1 


(0.8) 






2261 


:i.2) 




2231 


;i.7) 


225 1 


[1.1) 




1996 


39 1 


:i.i) 




361 


;i.5) 


36 1 


(0.7) 






229 1 


:i.2) 




224 1 


[2.8) 


228 1 


[1.2) 


4 to 5 hours 


1992 


20 1 


:o.7) 




22 \ 


;i.5) 


22 1 


(0.8) 






220 1 


:i.5) 




219 4 


[2.7) 


221 1 


[1.3) 




1996 


17 1 


: o.6)< 




19 4 


;i.2) 


20 1 


(0.7) 






225 1 


:i.7) 




216 4 


[3.1) 


224 1 


[1.5) 


6 hours or mors 


1992 


15 1 


:i.o) 




20 4 


;i.5) 


22 1 


(0.8) 






208 1 


:i.8) 




206 4 


[2.0) 


204 1 


[1.1) 




1996 


11 1 


: o.9)< 




174 


;i.4) 


20 1 


(0.8) 






212 1 


[2.2) 




208 4 


[3.1) 


208 1 


[1.5) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Apj^ndix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than die value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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TABLE 7.3B - GRADE 8 



Public School Students* Reports on Television Viewing Habits 



How much television do you usually 


Colorado 


West 


Nation 


watch each day? 


Percentage and Average Scale Score 



1 hour or less 


1990 


17 I 


(0.8) 


144 


(1.8) 


12 ( 


0.8) 






276 1 


(1.9) 


266 1 


(4.3) 


269 ( 


2.4) 




1992 


21 1 


(1.0)« 


184 


(1.4) 


15 ( 


0.6)» 






260 1 


(1.9) 


278 4 


(4.0) 


276 ( 


2.2) 




1996 


21 1 


(1.0)« 


20 4 


(1.4) 


17( 


0.6)» 






284 1 


( 2.0)« 


277 4 


(3.3) 


277 ( 


2.7) 


2 to 3 hours 


1990 


46 1 


(1.0) 


40 4 


(1.8) 


43 ( 


1.1) 






270 1 


(1.1) 


262 4 


(2.8) 


267 ( 


1.4) 




1992 


50 1 


(1.0) 


47 4 


(1.1)« 


45 ( 


0.6) 






275 1 


[1.2)« 


273 4 


(1.9)« 


274 ( 


1.1 )« 




1996 


50 1 


(1.1) 


46 4 


(1.4) 


45 ( 


0.9) 






2791 


[1.2)« 


270 4 


(2.0) 


276 ( 


1.1)« 


4 to 5 hours 


1990 


25 1 


(0.9) 


29 4 


(1.7) 


26 ( 


1.1) 






263 1 


(1.3) 


264 4 


(2.6) 


262 ( 


1.6) 




1992 


22 1 


(0.9) 


23 4 


(1.2)« 


26 ( 


0.7) 






2671 


(1.4) 


259 4 


(1.9) 


261 ( 


1.1) 




1996 


20 4 


: 0.9)« 


23 4 


(1.1)« 


24 ( 


0.7)« 






269 4 


(1.8) 


. 266 4 


(2.6) 


266 ( 


1.4)«> 


6 hours or more 


1990 


94 


(0.7) 


164 


:2.0) 


16( 


1.0) 






249 4 


(2.3) 


245 4 


:a.2) 


245 ( 


2.0) : 




1992 


74 


(0.6) 


124 


:o.9) 


13 ( 


0.4) 






253 4 


(2.7) 


244 4 


(3.7) 


243 ( 


1.5) 




1996 


94 


(0.7) 


11 4 


:o.9) 


14( 


0.6) 






254 4 


(2.6) 


253 4 


:3.o) 


252 ( 


1.4)«> 



y 



The NA£P mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation » («) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1990 at about the 95 percent confidence level. If the notation > (<) 
appears, it signifies that the value for public school students was significantly higher Gower) than the value for 1992 at 
about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990, 1992, 
and 1996 Mathematics Assessments. 
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Parental Support 

When parents are involved in their children’s education, both children and parents 
are likely to benefit. Research on students at risk has shown that parents’ participation 
in their children’s education has more effect on the child’s performance than parent 
income or parent education.^^ Parental involvement is naturally part of the home 
environment, but it is also increasingly sought in the school. 

As part of the NAEP assessment, the principals of participating students were 
asked about parental involvement in their schools. Tables 7.4A and 7.4B present the 
results for fourth and eighth graders, respectively, in public schools in Colorado. 
According to these results: 

• Overall, almost all of the fourth-grade students attended schools where 
principals characterized parental support as very positive (46 percent) 
or somewhat positive (51 percent). 

• Overall, almost all of the eighth-grade students attended schools where 
principals characterized parental support as very positive (48 percent) 
or somewhat positive (44 percent). 
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TABLE 7.4A - GRADE 4 



Public Schools* Reports on Parental Support 



How would you characterize parental 


Colorado 


West 


Nation 


support for student achievement within 
your school? 


Percentage and Average Scale Score 



Somewhat to very negative 


1992 


11 (2.9) 


4(1.6) 


5(1.2) 






212(3.5)! 


200 ( 3.8)1 


202 ( 4.9)1 




1996 


3(1.8) 


6 ( 2.8) 


5(1.5) 






*** 


*** 


200 ( 5.8)1 


Somewhat positive 


1992 


43 ( 4.6) 


56 ( 7.4) 


54 ( 3.2) 






217(1.5) 


214 (2.8) 


215 ( 1.3) 




1996 


51 ( 5.2) 


50 ( 6.7) 


52 ( 3.7) 






224 ( 1.7)> 


219(2.4) 


220( 1.3)> 


Very positive 


1992 


46 ( 4.5) 


41 ( 6.9) 


41 ( 3.2) 






227 ( 1.4) 


224 ( 2.3) 


225( 1.7) 




1996 


46 ( 5.3) 


44 ( 6.3) 


43 ( 3.9) 






230(2.1) 


221 ( 2.8) 


227 ( 1.7) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher Gower) than the value for 1992 at about the 95 percent confidence level. ! Interpret with caution 
— the nature of the sample does not allow accurate determination of the variability of this statistic. *** Sample size is 
insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Office of Educational Research and Improvement. Mapping out the National Assessment of Title /: The Interim Report 
— 1996. (Washington, DC: Office of Educational Research and Improvement, U.S. Department of Education, 1996). 
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Public Schools* Reports on Parental Support 


State Assessment 



How woufd you characterize parentai 


Colorado 


West 


Nation 


support for student achievement within 
your school? 


Percentage and Average Scale Score 



Somewhat to very negative 


1992 


91 


(2.6) 


9 1 


(3.6) 


101 


(2.3) 






259 1 


[ 4.4)! 


257 1 


( 5.3)1 


258 1 


( 2.4)1 




1996 


81 


(2.2) 


61 


(2.7) 


71 


(2.3) 






261 1 


[1.8)1 


269 1 


( 6.3)1 


271 1 


( 3.4)l> 


Somewhat positive 


1992 


49 1 


(4.6) 


60 1 


(4.8) 


62 1 


(3.2) 






270 1 


(1.8) 


266 1 


(2.5) 


265 < 


: 1.2) 




1996 


44 1 


(4.5) 


57 1 


(8.9) 


57 1 


(4.8) 






270 1 


(1.9) 


269 1 


(3.0) 


268 1 


(1.5) 


Very positive 


1992 


42 1 


(4.6) 


31 1 


(5.1) 


28 1 


(3.0) 






277 1 


(1.5) 


277 1 


(4.1) 


276 1 


(2.1) 




1996 


48 1 


(4.4) 


37 1 


(8.0) 


35 1 


(4.5) 






283 1 


(1.9) 


270 1 


( 4.7)1 


277 1 


(2.7) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret with caution 
— the nature of the sample does not allow accurate determination of the- variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Stiudsnt Mobility 

Research indicates that moving more than once or twice during the school year 
lowers student achievement. Students who attend the same school throughout their 
career are most likely to graduate, whereas the most mobile of the school populations 
have the highest rates of failure and dropping out.^ 

In order to look at the relationship between mobility and mathematics 
achievement, students were asked how many times within the past two years they had 
changed schools because they had changed where they lived. Table 7.5A shows results 
for fourth-grade public school students. 



• In terms of student mobility, 60 percent of fourth graders reported not 
moving over the last two years while 11 percent of students reported 
doing so three or more times. The students with the highest reported 
mobility had an average scale score (215) that was lower than Aat of 
those who reported not moving (230). 

• The percentage of students in Colorado who reported moving three or 
more times (11 percent) was not significantly different from the 
percentage for the nation (11 percent). 
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TABLE 7.5A — GRADE 4 



Public School Students’ Reports on Mobility 





Within the past two years, how many 
times have you changed schools 
because you changed where you 
lived? 


Colorado 


West 


Nation 


Percentage and Average Scale Score 









None 


1992 


58 ( 1 .3) 


56 ( 1.3) 


60 ( 0.9) 






226 ( 1 .0) 


225 ( 1.8) 


225 ( 0.9) 




1996 


60 ( 1.3) 


55 ( 2.0) 


62(1.1) 






230 ( 1.1) 


224 ( 2.8) 


227 ( 1.2) 


One 


1992 


20 ( 0.9) 


20 ( 1.0) 


19 ( 0.6) 






219 ( 1.5) 


217 ( 2.3) 


216(1.6) 




1996 


21 ( 0.9) 


22 ( 0.9) 


19 ( 0.7) 






223 ( 1 .5) 


216 ( 3.4) 


221 (1.9) 


Two 


1992 


9 ( 0.6) 


10 ( 0.6) 


9 ( 0.4) 






214(2.0) 


210(2.6) 


206(1.7) 




1996 


e ( 0.6) 


9 ( 0.6) 


8 ( 0.5) 






221 ( 2.3) 


210(4.4) 


210(2.1) 


Three or more 


1992 


14(0.9) 


14(0.8) 


13 ( 0.5) 






206 ( 2.0) 


200 ( 2.6) 


201 (1.6) 




1996 


11 (0.7) 


14 ( 1.9) 


11 (0.8) 






215 (3.1) 


207 ( 3.9) 


207 ( 2.0) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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ERIC Clearinghouse on Urban Education. Highly Mobile Students: Educational Problems and Possible Solutions. (New 
York, NY: ERIC Clearinghouse on Urban Education, ERIC/CUE Digest, Number 73, 1991). 
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Eighth-grade public school students were also asked about their mobility. As 
shown in Table 7.5B, the results based on 1996 eighth graders’ reports of mobility 
indicate the following: 

• In terms of student mobility, 67 percent of eighth graders reported not 
having moved over the last two years, while 8 percent of students 
reported doing so three or more times. The students with the highest 
reported mobility had an average scale score (261) that was lower than 
that of those who reported not moving (280). 

• In Colorado, the percentage of students who reported moving three or 
more times (8 percent) was not significantly different from the 
percentage for the nation (6 percent). 
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TABLE 7.5B - GRADE 8 



Public School Students’ Reports on Mobility 



Wfthfn the past two years, how many 
times have you changed schools 
because you changed where you 
lived? 



Colorado 



West 



Nation 



Percentage and Average Scale Score 



None 


1992 


74 ( 0.7) 
276 ( 1.0) 


74(1.5) 
271 ( 2.1) 


76 ( 0.7) 
271 ( 1.0) 




1996 


67 ( 1.3)< 
260 ( 1.3) 


68( 1.0)< 
275 ( 2.1) 


74 ( 0.7)< 
276(1.1)> . 


One 


1992 


15 ( 0.6) 
265 ( 2.1) 


16 ( 1.0) ■ 
264 ( 3.3) 


14(0.4) 
262 ( 1.6) 




1996 


16 ( 1.0) 
275 ( 2.3)> 


16(0.7) 
261 ( 3.7) 


14(0.5) 
262 ( 2.0) 


Two 


1992 


5 ( 0.4) 
265 ( 2.4) 


5 ( 0.5) 
254 ( 5.6) 


5(0.4) 
250 ( 2.9) 




1996 


7 ( 6.5) 
265 ( 2.6) 


7 ( 0.5) 
253 ( 3.2) 


5 ( 0.4) 
253 ( 2.7) 


Three or more 


1992 


5 ( 0.4) 
254(3.1) 


5 ( 0.6) 
249 ( 3.4) 


4 ( 0.3) 
245 ( 2.3) 




1996 


6 ( 0.6)> 
261 ( 2.6) 


6 ( 0.6)> 
257 ( 3.7) 


6 ( 0.3)> 
254 ( 2.6)> 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 s tandar d errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Students’ Views About Mathematics 

The attitudes children form about mathematics can affect the depth to which they 
learn the concepts. These same attitudes can also affect decisions that middle school 
students make about what mathematics courses they will study. Failure to study 
mathematics can close the doors to education beyond high school, and to many 
interesting and exciting careers. Thus, students’ attitudes and beliefs about mathematics 
can be a contributing factor affecting the skills they will acquire. 

Do Students Believe That Math Is Useful for Everyday Problems? 

If children view mathematics as a practical, useful subject, they may better 
understand that it can be applied to a wide variety of real-world problems and 
phenomena. The NCTM Standards explain that, even though most mathematical ideas 
in the kindergarten through fourth grade curriculum arise from the everyday world, they 
must be regularly applied to real-world situations. Further, children need to understand 
that mathematics is an integral part of real-world situations and activities in other 
curricular areas. One major purpose of mathematics is to help children understand and 
interpret their world and solve problems that occur in it. This important view of 
mathematics must continue through the curriculum for grades 5 through 8. Teachers 
should emphasize the application of mathematics to real-world problems as well as to 
other settings relevant to middle school students. 

In order to examine whether mathematics has been made relevant to the students, 
they were asked the degree to which they agreed or disagreed with the statement that 
mathematics is useful for solving everyday problems. Responses by fourth-grade public 
school students are reported in Table 7. 6 A. According to their responses: 

• About three quarters of the fourth graders in Colorado agreed with the 
statement that mathematics is useful for solving everyday problems 
(72 percent). This percentage was greater than that of students 
disagreeing with the statement (11 percent). 

• The percentage of students in the state agreeing that mathematics is 
useful for everyday problems (72 percent) was somewhat greater than 
the percentage seen nationally (68 percent). 
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TABLE 7.6A - GRADE 4 


Public School Students’ Views on the Usefulness of 
Mathematics 


Stats Assessment 



To what degree do you agree with the 
statement “Mathematics is useful for 
solving everyday problems?'' 



Colorado 


West 


Nation 


Percentage and Average Scale Score 



Disagree 


1992 


12 ( 


(0.6) 


134 


(1.1) 


13( 


(0.6) 






211 { 


:i.9) 


208 1 


(2.7) 


207 ( 


(1.7) 




1996 


11 { 


:o.7) 


16 ( 


(1.2) 


14 4 


(0.7) 






214 < 


:2.2) 


207 4 


(4.0) 


211 4 


(2.0) 


Undecided 


1992 


24 ( 


:o.8) 


194 


(1.4) 


21 4 


(0.9) 






218 4 


:i.4) 


214 4 


(2.3) 


218 4 


(1.3) 




1996 


18 4 


: i.o)< 


184 


(1.4) 


18 4 


( 0.7)< 






221 4 


:2.o) 


216 4 


(2.1) 


221 4 


(1.5) 


Agree 


1992 


65 4 


: 1.0) 


69 4 


(1.9) 


66 4 


(1.1) 






226 4 


: 1.0) 


223 4 


(1.9) 


223 4 


(0.9) 




1996 


72 4 


: o.9)> 


66 4 


(1.7) 


68 4 


(0.9) 






230 4 


:i.o)> 


225 4 


(1.9) 


228 4 


(1.0)> 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of'the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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Eighth graders were also asked about the usefulness of mathematics to solve 
everyday problems. According to the responses of eighth-grade public school students 
in Colorado, as shown in Table 7.6B, the following was true: 

• Overall, a large majority of the eighth graders strongly agreed 
(37 percent) or agreed (43 percent) that mathematics was useful for 
solving everyday problems. A small percentage strongly disagreed 
(2 percent) or disagreed (6 percent). 

• The percentage of students in Colorado strongly agreeing that 
mathematics is useful for everyday problems (37 percent) was 
somewhat smaller than the percentage seen nationally (41 percent). 
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TABLE 7.6B - GRADE 8 



Public School Students* Views on the Usefulness of 
Mathematics 



To what degree do you agree with the 
atatement “Mathemattes la uaaful for 
aoMng everyday problems?” 



Colorado 


West 


Nation 


Percentego and Average Scale Score 



Strongly disagree 


1992 


2 ( 0.3) 


1 ( 0.2) 


2 ( 0.2) 






(**.*) 


(-.*) 


248 ( 3.5) 




1996 


2(0.3) 


2 ( 0.5) 


2 ( 0.2) 








*** (**.*) 


251 ( 4.3) 


Disagree 


1992 


4 ( 0.3) 


5 ( 0.5) 


5 ( 0.4) 






257 ( 3.1) 


259 ( 5.5) 


282(3.1) 




1996 


0 ( 0.4)> 


0(0.5) 


5 ( 0.4) 






267 ( 2.8) 


249 ( 4.7) 


258 ( 2.0) 


Undecided 


1992 


14 ( 0.7) 


11 (0.0) 


12 ( 0.5) 






268 ( 1.0) 


267 ( 3.6) 


267 ( 1 .9) 




1996 


12(0.7) 


13 ( 0.0) 


12(0.6) 






275 ( 2.5) 


270 ( 3.8) 


273 ( 2.9) 


Agree 


1992 


45 ( 1.0) 


44 ( 1.3) 


43 ( 0.7) 






276 ( 1.2) 


270 ( 2.2) 


270 ( 1.1) 




1996 


43 ( 1.3) 


39 ( 1.4) 


40 ( O.0)< 






279 ( 1.3) 


272 ( 2.3) 


274 ( 1.1) 


Strongly agree 


1992 


36 ( 1.1) 


39 ( 1.2) 


30 ( 0.7) 






275 ( 1 .4) 


270 ( 2.8) 


269 ( 1.2) 




1998 


37 ( 1 .2) 


39 ( 2.0) 


41 ( 1.2) 






276 ( 1 .5) 


272 ( 2.2) 


272 ( 1.2) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for tte entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1992 at atout the 95 percent confidence level. *** Sample size is 
insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 



160 



160 



THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



Colorado 



Do Students Believe Mathematics Is a Static Discipline? 

Do students believe that mathematics is a static, unchanging, rule-bound discipline 
or a dynamic, flexible way of approaching problem-solving situations? This question 
is key to the mathematics curricula described in the NCTM Standards, Curricula should 
emphasize the development of students’ mathematical thinking and reasoning abilities. 
Although learning the basic facts and rules remains important, memorization of facts and 
rules without understanding and not being able to use them appropriately is not helpful. 
Curricula should also emphasize the importance of flexibility in choosing strategies and 
techniques for solving mathematical problems. Successful problem solving, employing 
flexibility in approach and technique, should lead to confidence and perseverance in 
solving higher level problems. 

Students were asked whether they agreed or disagreed with the two statements that 
learning mathematics is mostly memorizing facts and that there is only one way to solve 
a mathematical problem. Responses by fourth-grade public school students are reported 
in Table 7.7A. According to their responses, the following is true: 

• Less than one fifth of the fourth graders in Colorado disagreed with the 
statement that mathematics is mostly memorizing facts (18 percent). 

This percentage was smaller than that of students agreeing with the 
statement (55 percent). 

• When asked if there is only one way to solve a mathematics problem, 

60 percent of fourth graders disagreed. This percentage was greater 
than that of students agreeing with this belief (16 percent). 

• The percentage of students in the state disagreeing that mathematics is 
the memorization of facts (18 percent) was not significantly different 
from the percentage in the nation (21 percent). Similarly, the 
percentage disagreeing with the belief that there is only one solution to 
a mathematics problem (60 percent) was not significantly different from 
the national percentage (63 percent). 
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TABLE 7.7k — GRADE 4 


Public School Students^ Views on the Nature of Mathematics 


State Assessment 



To what degree do you agree with the 


Colorado 


West 


Nation 


following statements? 


Percentage and Average Scale Score 



Learning mathematics Is mostly 








memorizing facts. 








Disagree 


18 ( 1.0) 


19 ( 1.2) 


21 ( 0.9) 




234 ( 2.2) 


227 ( 2.5) 


233 ( 1.6) 


Undecided 


27 ( 0.8) 


23 ( 0.9) 


25 ( 0.6) 




228 ( 1.6) 


223 ( 3.0) 


226 ( 1.3) 


Agree 


55 ( 1.2) 


58 ( 1.2) 


55 ( 0.9) 




224 ( 1.1) 


218(2.0) 


220 ( 1.0) 


There Is only one correct way to 








solve a mathematics problem. 








Disagree 


60 ( 1 .6) 


61 ( 1.9) 


63 ( 0.9) 




233 ( 1.1) 


228 ( 1.7) 


231 ( 1.0) 


Undecided 


24(1.1) 


20 ( 1 .3) 


20 ( 0.7) 




221 ( 1 .5) 


216 ( 3.1) 


219(1.7) 


Agree 


16 ( 0.9) 


19(1.0) 


17(0.6) 




211 ( 1.8) 


202 ( 3.4) 


205 ( 1.6) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP)^ 1996 

Mathematics Assessment. 



Eighth graders were also asked about their beliefs about the nature of mathematics. 
The responses of eighth-grade public school students in Colorado, as shown in Table 
7.7B, indicate that: 

• Overall, about one third of the eighth graders strongly disagreed 
(9 percent) or disagreed (25 percent) that mathematics is mostly 
memorizing facts. About one third strongly agreed (8 percent) or 
agreed (26 percent). 

• The percentage of students in the state strongly disagreeing that 
mathematics is mostly memorizing facts was somewhat greater than the 
percentage seen nationally (7 percent). 

• Overall, a large majority of the eighth graders strongly disagreed 
(38 percent) or disagreed (42 percent) that there was only one way to 
solve a mathematical problem. A small percentage strongly agreed 
(2 percent) or agreed (5 percent). 

• The percentage of students in the state strongly disagreeing that there is 
one way to solve a mathematics problem was somewhat greater than the 
percentage seen nationally (34 percent). 
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TABLE 7.7B - GRADE 8 


Public School Students^ Views on the Nature of Mathematics 


State Assessment 





To what degree do you agree with the 
following statements? 


Colorado 


West 


Nation 


Percentage and Average Scale Score 









Learning mathematics Is mostly 








memorizing facts. 








Strongly disagree 


9 ( 0,6) 


6 ( 0,7) 


7 ( 0.4) 




284 ( 2.7) 


280 ( 3,7) 


282 ( 2.8) 


Disagree 


25 ( 0.9) 


19(2.1) 


22 ( 0.9) 




286 ( 1,7) 


281 ( 2.8) 


283 ( 2.0) 


Undecided 


32 ( 1.0) 


31 ( 1.0) 


28 ( 0.7) 




276 ( 1 .5) 


271 ( 1 .8) 


274 ( 1 .4) 


Agree 


26 ( 1 .1 ) 


32 ( 1 .5) 


30 ( 0.7) 




268 ( 1.9) 


263 ( 2.0) 


265 ( 1.1) 


Strongly agree 


8 ( 0.6) 


12 ( 1.5) 


12 ( 0.6) 




262 ( 3.2) 


256 ( 4.0) 


255 ( 1 .9) 


There is only one correct way to 








solve a mathematics problem. 








Strongly disagree 


38 ( 1.2) 


34(1.7) 


34 ( 0.9) 




282 ( 1.4) 


278 ( 2.0) 


279 ( 1.3) 


Disagree 


42 ( 1.1) 


41(1.3) 


43 ( 0.7) 




277 ( 1.5) 


271 ( 2.4) 


273 ( 1 .2) 


^ Undecided 


13 ( 0.7) 


16 ( 1.2) 


14 ( 0.6) 




269 ( 2.1) 


261 ( 3.2) 


263 ( 1 .9) 


Agree 


5 ( 0.6) 


6 ( 0.8) 


5 ( 0.4) 




256 ( 4.2) 


237 ( 5.2) 


243 ( 2.7) 


Strongly agree 


2 ( 0.3) 


2 ( 0.4) 


2 ( 0.2) 




...(...) 


...(...) 


245 ( 3.6) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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APPENDIX A 



Reporting NAEP 1996 Mathematics Results 
for Colorado 

A.1 Participation Guidelines 



As was discussed in the Introduction, unless the overall participation rate is 
sufficiently high for a jurisdiction, there is a risk that the assessment results for that 
jurisdiction will be subject to appreciable nonresponse bias. Moreover, even if the 
overall participation rate is high, there may be significant nonresponse bias if the 
nonparticipation that does occur is heavily concentrated among certain types of schools 
or' students. The following guidelines concerning school and student participation rates 
in the state assessment program were established to address four significant ways in 
which nonresponse bias could be introduced into the jurisdiction sample estimates. The 
guidelines determining a jurisdiction’s eligibility to have its results published are 
presented below. Also presented below are the conditions that will result in a 
jurisdiction’s receiving a notation in the 1996 reports. Note that in order for a 
jurisdiction’s results to be published with no notations, that jurisdiction must satisfy all 
guidelines. (A more complete discussion of the NAEP participation guidelines can be 
found in the Technical Report of the NAEP 1996 State Assessment Program in 
Mathematics.) 

Guidelines on the Publication of NAEP Results 



Guideline 1 — Publication of Public School Results 
A jurisdiction will have its public school results published in the NAEP 
1996 Mathematics Report Card (or in other reports that include all 
state-level results) if and only if its weighted participation rate for the 
initial sample of public schools is greater than or equal to 70 percent. 
Similarly, a jurisdiction will receive a separate NAEP 1996 Mathematics 
State Report if and only if its weighted participation rate for the initial 
sample of public schools is greater than or equal to 70 percent. 
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Guideline 2 — Publication of Nonpublic School Results 
A jurisdiction will have its nonpublic school results published in the 
NAEP 1996 Mathematics Report Card (or in other reports that include 
all state-level results) if and only if its weighted participation rate for 
the initial sample of nonpublic schools is greater than or equal to 70 
percent AND meets minimum sample size requirements.* A 
jurisdiction eligible to receive a separate NAEP 1996 Mathematics State 
Report under guideline 1 will have its nonpublic school results included 
in that report if and only if that jurisdiction’s weighted participation rate 
for the initial sample of nonpublic schools is greater than or equal to 
70 percent AND meets minimum sample size requirements. If a 
jurisdiction meets guideline 2 but fails to meet guideline 1, a separate 
NAEP 1996 Mathematics State Report will be produced containing only 
nonpublic school results. 

Guideline 3 — Publication of Combined Public and 
Nonpubtic School Results 

A jurisdiction will have its combined results published in the NAEP 
1996 Mathematics Report Card (or in other reports that include all 
state-level results) if and only if both guidelines 1 and 2 are satisfied. 
Similarly, a jurisdiction eligible to receive a separate NAEP 1996 
Mathematics State Report under guideline 1 will have its combined 
results included in that report if and only if guideline 2 is also met. 

Guidelines for Notations of NAEP Results 

Guideline 4 — Notation for Overall Public School 
Participation Rate 

A jurisdiction that meets guideline 1 will receive a notation if its 
weighted participation rate for the initial sample of public schools was 
below 85 percent AND the weighted public school participation rate 
after substitution was below 90 percent. 

Guideline 5 — Notation for Overall Nonpublic School 
Participation Rate 

A jurisdiction that meets guideline 2 will receive a notation if its 
weighted participation rate for the initial sample of nonpublic schools 
was below 85 percent AND the weighted nonpublic school participation 
rate after substitution was below 90 percent. 
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Minimum participation size requirements for reporting nonpublic school data consist of two components: (1) a school 
sample size of six or more participating schools and (2) an assessed student sample size of at least 62. 
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Guideline 6 — Notation for Strata-Specific Public 
School Participation Rate 

A jurisdiction that is not already receiving a notation under 
guideline 4 will receive a notation if the sample of public schools 
included a class of schools with similar characteristics that had a 
weighted participation rate (after substitution) of below 80 percent, and 
from which the nonparticipating schools together accounted for more 
than five percent of the jurisdiction’s total weighted sample of public 
schools. The classes of schools from each of which a jurisdiction 
needed minimum school participation levels were determined by degree 
of urbanization, minority enrollment, and median household income of 
the area in which the school is located. 

Guideline 7 — Notation for Strata-Specific Nonpublic 
School Participation Rate 

A jurisdiction that is not already receiving a notation under 
guideline 5 will receive a notation if the sample of nonpublic schools 
included a class of schools with similar characteristics that had a 
weighted participation rate (after substitution) of below 80 percent, and 
from which the nonparticipating schools together accounted for more 
than five percent of the jurisdiction’s total weighted sample of 
nonpublic schools. The classes of schools from each of which a 
jurisdiction needed minimum school participation levels were 
determined by type of nonpublic school (Catholic versus non-Catholic) 
and location (metropolitan versus nonmetropolitan). 

Guideline 8 — Notation for Overall Student Participation 
Rate in Public Schools 

A jurisdiction that meets guideline 1 will receive a notation if the 
weighted student response rate within participating public schools was 
below 85 percent. 

Guideline 9 — Notation for Overall Student Participation 
Rate in Nonpublic Schools 

A jurisdiction that meets guideline 2 will receive a notation if the 
weighted student response rate within participating nonpublic schools 
was below 85 percent. 
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Guideline 10 — Notation for Strata-Specific Student 
Participation Rates in Public Schools 
A jurisdiction that is not already receiving a notation under 
guideline 8 will receive a notation if the sampled students within 
participating public schools included a class of students with similar 
characteristics that had a weighted student response rate of below 80 
percent, and from which the nonresponding students together accounted 
for more than five percent of the jurisdiction’s weighted assessable 
public school student sample. Student groups from which a jurisdiction 
needed minimum levels of participation were determined by the age of 
the student, whether or not the student was classified as a student with 
a disability (SD) or of limited English proficiency (LEP), and the type 
of assessment session (monitored or unmonitored), as well as school 
level of urbanization, minority enrollment, and median household 
income of the area in which the school is located. 

Guideline 11 — Notation for Strata-Specific Student 
Participation Rates in Nonpublic Schools 
A jurisdiction that is not already receiving a notation under 
guideline 9 will receive a notation if the sampled students within 
participating nonpublic schools included a class of students with similar 
characteristics that had a weighted student response rate of below 80 
percent, and from which the nonresponding students together accounted 
for more than five percent of the jurisdiction’s weighted assessable 
nonpublic school student sample. Student groups from which a 
jurisdiction needed minimum levels of participation were determined 
by the age of the student, whether or not the student was classified as 
a student with a disability (SD) or of limited English proficiency (LEP), 
and the type of assessment session (monitored or unmonitored), as well 
as type and location of school. 
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A.2 NAEP Reporting Groups 

The state assessment program provides results for groups of students defined by 
shared characteristics — region of the country, gender, race/ethnicity, parental education, 
location of the school, type of school, participation in Title I programs, and eligibility 
for the free/reduced-price lunch component of the National School Lunch Program. 
Based on criteria described later in this appendix, results are reported for subpopulations 
only when sufficient numbers of students and adequate school representation are present. 
For public school students, the minimum requirement is at least 62 students in a 
particular subgroup from at least 5 primary sampling units (PSUs).^ For nonpublic 
school students, the minimum requirement is 62 students from at least 6 different schools 
for the state assessment program or from at least 5 PSUs for the national assessment. 
However, the data for all students, regardless of whether their subgroup was reported 
separately, were included in computing overall results. Definitions of the subpopulations 
referred to in this report are presented on the following pages. 

Region 

Results are reported for four regions of the nation: Northeast, Southeast, Central, 
and West. States included in each region are shown in Figure A.l. All 50 states and 
the District of Columbia are listed. Territories and the two Department of Defense 
Educational Activities jurisdictions were not assigned to any region. 

Regional results are based on national assessment samples, not on aggregated state 
assessment program samples. Thus, the regional results are based on a sample that is 
different and separate from that used to report the state results. 
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FIGURE A.1 



Regions of the Country 



NORTHEAST 


SOUTHEAST 


CENTRAL 


WEST 




Connecticut 

Delaware 

District of Columbia 
Maine 
Maryland 
Massachusetts 
New Hampshire 
New Jersey 
New York 
Pennsylvania 
Rhode Island 
Vermont 
Virginia* 


Alabama 
Arkansas 
Florida 
Georgia 
Kentucky 
Louisiana 
Mississippi 
North Carolina 
South Carolina 
Tennessee 
Virginia* 
West Virginia 


Illinois 
Indiana 
Iowa 
Kansas 
Michigan 
Minnesota 
Missouri 
Nebraska 
North Dakota 
Ohio 

South Dakota 
Wisconsin 


Alaska 

Arizona 

California 

Colorado 

Hawaii 

Idaho 

Montana 

Nevada 

New Mexico 
Oklahoma 
Oregon 
Texas 
Utah 

Washington 

Wyoming 



* The part of Virginia that is included in the Washington, DC, metropolitan area is included in the Northeast region; the 
remainder of the state is in the Southeast region. 



^ For the Stale Assessment Program, a PSU is most often a single school; for the national assessment, a PSU is a selected 
geographic region (a county, group of counties, or a metropolitan statistical area). 
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Gender 

Results are reported separately for males and females. 

Race/Ethnicity 

The race/ethnicity variable is derived from two questions asked of students and 
schools’ records, and it is used for race/ethnicity subgroup comparisons. Two questions 
from the set of general student background questions were used to determine 
race/ethnicity: 



If you are Hispanic, what is your Hispanic background? 
° I am not Hispanic. 

° Mexican, Mexican American, or Chicano 
° Puerto Rican 
° Cuban 

° Other Spmish or Hispanic background 



Students who responded to this question by filling in the second, third, fourth, or 
fifth oval were considered Hispanic. For students who filled in the first oval, did not 
respond to the question, or provided information that was illegible or could not be 
classified, responses to the question below were examined in an effort to determine 
race/ethnicity. 



Which best describes you? 

° White (not Hispanic) 

° Black (not Hispanic) 

° Hispanic (“Hispanic” means someone who is from a Mexican, 
Mexican American, Chicano, Puerto Rican, Cuban, 
or other Spanish or Hispanic background.) 

° Asian or Pacific Islander (“Asian or Pacific Islander” 
means someone who is from a Chinese, Japanese, Korean, 

Filipino, Vietnamese, or other Asian or Pacific Island background.) 

American Indian or Alaskan Native (“American Indian or 
Alaskan Native” means someone who is from one of the American 
Indian tribes, or one of the original people of Alaska.) 

° Other (specify) 
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Students’ race/ethnicity was then assigned on the basis of their response. For 
students who filled in the sixth oval (“Other”) or provided illegible information or 
information that could not be classified, or did not respond at all, race/ethnicity was 
assigned as determined by school records.’ 

Race/ethnicity could not be determined for students who did not respond to either 
of the demographic questions and whose schools did not provide information about 
race/ethnicity. 

The details of how race/ethnicity classifications were derived is presented so that 
readers can determine how useful the results are for their particular purposes. Also, 
some students indicated that they were from a Hispanic background (e.g., Puerto Rican 
or Cuban) and that a racial/ethnic category other than Hispanic best described them. 
These students were classified as Hispanic based on the rules described above. 
Furthermore, information from the schools did not always correspond to how students 
described themselves. Therefore, the racial/ethnic results presented in this report attempt 
to provide a clear picture based on several sources of information. 

As noted in Chapters 2 and 4, national and regional scale score and achievement 
level results for eighth-grade Asian/Pacific Islander students are not included in the main 
body of this report. The decision not to publish these results is discussed in 
Appendix F. 

Parents’ Highest Level of Education 

The variable representing level of parental education is derived from responses to 
two questions from the set of general student background questions. Students were 
asked to indicate the extent of their mother’s education: 

How far in school did your mother go? 

° She did not finish high school. 

° She graduated from high school. 

° She had some education after high school. 

° She graduated from college. 

° I don’t know. 



Students were asked a similar question about their father’s education level: 

How far in school did your father go? 

° He did not finish high school. 

° He graduated from high school. 

° He had some education after high school. 

° He graduated from college. 

° I don’t know. 



’ The procedure for assigning race/ethnicity was modified for Hawaii. See the Technical Report for the NAEP 1996 State 
Assessment Program in Mathematics for details. 

THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



Colorado 



The information was combined into one parental education reporting variable 
determined through the following process. If a student indicated the extent of education 
for only one parent, that level was included in the data. If a student indicated the extent 
of education for both parents, the higher of the two levels was included in the data. If 
a student did not know the level of education for both parents or did not know the level 
for one parent and did not respond for the other, the parental education level was 
classified as “I don’t know.” If the student did not respond for either parent, the student 
was recorded as having provided no response. (Nationally, 36 percent of fourth graders 
and 1 1 percent of eighth graders reported that they did not know the education level of 
either of their parents.) 

Type of Location 

Results are provided for students attending public schools in three mutually 
exclusive location types — central city, urban fringe/large town, and rural/small town 
— as defined below. The type of location variable is defined in such a way as to indicate 
the geographical location of a student’s school. The intention is not to indicate, or 
imply, social or economic meanings for these location types. The type of location 
variable, on which the current NAEP sampling is based, does not support the reporting 
of regional results. Therefore, only state and national results will be presented. 

Central City: The Central City category includes central cities of all 
Metropolitan Statistical Areas (MSAs).'' Central City is a geographic 
term and is not synonymous with “inner city.” 

Urban Fringe/Large Town: An Urban Fringe includes all densely 

settled places and areas within MSAs that are classified as urban by the 
Bureau of the Census. A Large Town is defined as places outside 
MSAs with a population greater than or equal to 25,000. 

Rural/Small Town: Rural includes all places and areas with a 

population of less than 2,500 that are classified as rural by the Bureau 
of the Census. A Small Town is defined as places outside MSAs with 
a population of less than 25,000 but greater than or equal to 2,500. 




I 



4 



Each Metropolitan Statistical Area (MSA) is defined by the Office of Management and Budget. 
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Type of School 

Samples for the 1996 state assessment program were expanded to include students 
attending nonpublic schools (Catholic schools and other religious and private schools) 
in addition to students attending public schools. The expanded coverage was instituted 
for the first time in 1994. Samples for the 1990 and 1992 Trial State Assessment 
progr ams had been restricted to public school students only. For those jurisdictions 
meeting pre-established participation rate standards (see earlier section of this appendix), 
separate results are reported for public schools, for nonpublic schools, and for the 
combined public and nonpublic school samples. The combined sample for each 
jurisdiction also contains students attending Bureau of Indian Affairs (BIA) schools and 
Department of Defense Domestic Dependent Elementary and Secondary Schools 
(DDESS) in that jurisdiction. These two categories of schools are not included in either 
the public or nonpublic school samples. 

Note that the DDESS and Department of Defense Dependents Schools 
(DoDDS)’ were assessed in 1996 as separate jurisdictions, reported as jurisdictions with 
public school samples only. 

Title I Participation 

Based on available school records, students were classified as either currently 
participating in a Title I program or receiving Title I services, or as not receiving such 
services. The classification applies only to the school year when the assessment was 
administered (i.e., the 1995-96 school year) and is not based on participation in previous 
years. If the school did not offer any Title I programs or services, all students in that 
school were classified as not participating. 

Eligibility for the Free/Reduced-Price School Lunch Program 

Based on available school records, students were classified as either currently 
eligible for the free/reduced-price lunch component of the Department of Agriculture’s 
National School Lunch Program or not eligible. The classification refers only to the 
school year when the assessment was administered (i.e., the 1995-96 school year) and 
is not based on eligibility in previous years. If school records were not available, the 
student was classified as “Information not available.’’ If the school did not participate 
in the progr am, all Students in that school were classified as “Information not available.” 

A.3 Quidsllnes for Analysis and Reporting 

This report describes mathematics performance for fourth and eighth graders and 
compares the results for various groups of students within these populations — for 
example, those who have certain demographic characteristics or who responded to a 
specific background question in a particular way. The report examines the results for 
individual demographic groups and individual background questions. It does not include 
an analysis of the relationships among combinations of these subpopulations or 
background questions. 

* The Department of Defense Dependents Schools (DoDDS) refers to overseas schools (i.e., schools outside the United 
States). Depaitxnent of Defense Domestic Dependent Elementary and Secondary Schools (DDESS) refers to domestic 
schools (i.e., schools in the United States). 
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Dravying Inferences from the Results 

Because the percentages of students in these subpopulations and their average 
scale scores are based on samples — rather than on the entire population of fourth and 
eighth graders in a jurisdiction — the numbers reported are necessarily estimates. As 
such, they are subject to a measure of uncertainty, reflected in the standard error of the 
estimate. When the percentages or average scale scores of certain groups are compared, 
it is essential to take the standard error into account, rather than to rely solely on 
observed similarities or differences. Therefore, the comparisons discussed in this report 
are based on statistical tests that consider both the magnitude of the difference between 
the averages or percentages and the standard errors of those statistics. 

One of the goals of the state assessment program is to estimate scale score 
distributions and percentages of students in the categories described in A.2 for the 
overall populations of fourth- and eighth-grade students in each participating Jurisdiction 
based on the particular samples of students assessed. The use of confidence intervals, 
based on the standard errors, provides a way to make inferences about the population 
average scale scores and percentages in a manner that reflects the uncertainty associated 
with the sample estimates. An estimated sample average scale score ± 2 standard errors 
approximates a 95 percent confidence interval for the corresponding population average 
or percentage. This means that one can conclude with approximately 95 percent 
confidence that the average scale score of the entire population of interest (e.g., all 
fourth-grade students in public schools in a Jurisdiction) is within ± 2 standard errors 
of the sample average. 

As an example, suppose that the average mathematics scale score of the students 
in a particular Jurisdiction’s eighth-grade sample were 256 with a standard error of 1.2. 
A 95 percent confidence interval for the population average would be as follows: 

Mean ± 2 standard errors = 256 ± 2 x (1.2) = 256 ± 2.4 = 

256 - 2.4 and 256 + 2.4 = (253.6, 258.4) 

Thus, one can conclude with 95 percent confidence that the average scale score 
for the entire population of eighth-grade students in public schools in that jurisdiction 
is between 253.6 and 258.4. 

Similar confidence intervals can be constmcted for percentages, if the percentages 
are not extremely large or extremely small. For extreme percentages, confidence 
intervals constructed in the above manner may not be appropriate, and accurate 
confidence intervals can be constmcted only by using procedures that are quite 
complicated. 

Extreme percentages, defined by both the magnitude of the percentage and the size 
of the sample from which it was derived, should be interpreted with caution. (The 
forthcoming Technical Report of the NAEP 1996 State Assessment Program in 
Mathematics contains a more complete discussion of extreme percentages.) 
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Analyzing Subgroup Differences in Averages and Percentages 

The statistical tests determine whether the evidence — based on the data from the 
groups in the sample — is strong enough to conclude that the averages or percentages 
are really different for those groups in the population. If the evidence is strong (i.e., the 
difference is statistically significant), the report describes the group averages or 
percentages as being different (e.g., one group performed higher than or lower than 
another group) — regardless of whether the sample averages or sample percentages 
appear to be about the same or not. If the evidence is not sufficiently strong (i.e., the 
difference is not statistically significant), the averages or percentages are described as 
being not significantly different — again, regardless of whether the sample averages or 
sample percentages appear to be about the same or widely discrepant. The reader is 
cautioned to rely on the results of the statistical tests — rather than on the apparent 
magnitude of the difference between sample averages or percentages — to determine 
whether those sample differences are likely to represent actual differences between the 
groups in the population. 

In addition to the overall results, this report presents outcomes separately for a 
variety of important subgroups. Many of these subgroups are defined by shared 
characteristics of students, such as their gender or race/ethnicity and the type of location 
in which their school is situated. Other subgroups are defined by the responses of the 
assessed students’ mathematics teachers to questions in the mathematics teacher 
questionnaire. 

In Chapter 1 of this report, differences between the jurisdiction and the nation were 
tested for overall mathematics scale score and for each of the mathematics content areas. 
In Chapter 2, significance tests were conducted for the overall scale score for each of 
the subpopulations. Chapter 3 reports differences between the jurisdiction and nation 
for the percentage of students at or above the Proficient level, and Chapter 4 contains 
significance tests for the percentage of students at or above the Proficient level for each 
of the subpopulations. In Chapters 5 through 7, comparisons were made across 
subgroups for responses to various background questions. 

As an example of comparisons across subgroups, consider the question: Do 
students who reported discussing studies at home almost every day exhibit higher average 
mathematics scale scores than students who report never or hardly ever doing so? 

To answer the question posed above, begin by comparing the average mathematics 
scale score for the two groups being analyzed. If the average for the group that reported 
discussing their studies at home almost every day is higher, it may be tempting to 
conclude that that group does have a higher mathematics scale score than the group that 
reported never or hardly ever discussing their studies at home. However, even though 
the averages differ, there may be no real difference in performance between the two 
groups in the population because of the uncertainty associated with the estimated average 
scale scores of the groups in the sample. Remember that the intent is to make a 
statement about the entire population, not about the particular sample that was assessed. 
The data from the sample are used to make inferences about the population as a whole. 
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As discussed in the previous section, each estimated sample average scale score 
(or percentage) has a degree of uncertainty associated \vith it. It is therefore possible 
that if all students in the population (rather than a sample of students) had been assessed 
or if the assessment had been repeated with a different sample of students or a different, 
but equivalent, set of questions, the performances of various groups would have been 
different. Thus, to determine whether there is a real difference between the average 
scale score (or percentage of a certain attribute) for two groups in the population, an 
estimate of the degree of uncertainty associated with the difference between the scale 
score averages or percentages of those groups must be obtained for the sample. This 
estimate of the degree of uncertainty — called the standard error of the difference 
between the groups — is obtained by taking the square of each group’s standard error, 
summing these squared standard errors, and then taking the square root of this sum. 

In a maimer similar to that in which the standard error for an individual group 
average or percentage is used, the standard error of the difference can be used to help 
determine whether differences between groups in the population are real. The difference 
between the mean scale score or percentage of the two groups — 2 standard errors of 
the difference — represents an approximate 95 percent confidence interval. If the 
resulting interval includes zero, there is insufficient evidence to claim a real difference 
between groups in the population. If the interval does not contain zero, the difference 
between groups is statistically significant (different) at the .05 level. 

As another example, to determine whether the average mathematics scale score 
of fourth-grade males is higher than that of fourth-grade females in a particular 
jurisdiction’s public schools, suppose that the sample estimates of the average scale 
scores and standard errors for males and females were as follows; 



Group 


Average Scale Score 


Standard Error 


Males 


218 


0.9 


Females 


216 


1.1 



The difference between the estimates of the average sale scores of males and 
females is two points (218 - 216). The standard error of this difference is 



V 0.9* + 1.1' = 1.4 

Thus, an approximate 95 percent confidence interval for this difference is 
Mean difference ± 2 standard errors of the difference - 

2 ± 2 X (1.4) = 2 ± 2.8 = 2 - 2.8 and 2 + 2.8 = (-0.8, 4.8) 
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The value zero is within this confidence interval, which extends from -0.8 to 4.8 
(i.e., zero is between -0.8 and 4.8). Thus, there is insufficient evidence to claim a 
difference in average mathematics scale score between the populations of fourth-grade 
males and females in public schools in the hypothetical jurisdiction.^ 

Throughout this report, when the average scale scores or percentages for two 
groups were compared, procedures like the one described above were used to draw the 
conclusions that are presented. If a statement appears in the report indicating that a 
particular group had a higher (or lower) average scale score than a second group, the 
95 percent confidence interval for the difference between groups did not contain zero. 
An attempt was made to distinguish between group differences that were statistically 
significant but rather small in a practical sense and differences that were both statistically 
and practically significant. A procedure based on effect sizes was used. Statistically 
significant differences that are rather small are described in the text as somewhat higher 
or somewhat lower. When a statement indicates that the average scale score or 
percentage of some attribute was not significantly different for two groups, the 
confidence interval included zero, and thus no difference could be assumed between the 
groups. The information described in this section also pertains to comparisons across 
years. The reader is cautioned to avoid drawing conclusions solely on the basis of the 
magnitude of the difference. A difference between two groups in the sample that 
appears to be slight may represent a statistically significant difference in the population 
because of the magnitude of the standard errors. Conversely, a difference that appears 
to be large may not be statistically significant. 

The procedures described in this section, and the certainty ascribed to intervals 
(e.g., a 95% confidence interval), are based on statistical theory that assumes that only 
one confidence interval or test of statistical significance is being performed. However, 
in each chapter of this report, many different groups are being compared (i.e., multiple 
sets of confidence intervals are being calculated). In sets of confidence intervals, 
statistical theory indicates that the certainty associated with the entire set of intervals is 
less than that attributable to each individual comparison from the set. To hold the 
certainty level for the set of comparisons at a particular level (e.g., 0.95), adjustments 
(called multiple comparison procedures) must be made to the methods described in the 
previous section. One such procedure — the Bonferroni method — was used in the 
analyses described in this report to form confidence intervals for the differences between 
groups whenever sets of comparisons were considered.^ Thus, the confidence intervals 
in the text that are based on sets of comparisons are more conservative than those 
described on the previous pages. 



^ The procedure described above (especially the estiroation of the standard error of the difference) is, in a strict sense, 
only appropriate when the statistics being compared come from independent samples. For certain comparisons in the 
report, the groups were not independent. In those cases, a different (and more appropriate) estimate of the standard 
error of the difference was used. 

^ Miller, R.G. Simultaneous Statistical Inference. (New York, NY: Wiley, 1966). 
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Most of the multiple comparisons in this report pertain to relatively small sets or 
“families” of comparisons. For example, when comparisons were discussed concerning 
students’ reports of parental education, six comparisons were conducted — all pairs of 
the four parental education levels. In these situations, Bonferroni procedures were 
appropriate. However, the maps in Chapter 1 of this report display comparisons between 
Colorado and all other participating jurisdictions. The “family” of comparisons in this 
case was as many as 46. To control the certainty level for a large family of comparisons, 
the False Discovery rate (FDR) criterion® was used. Unlike the Bonferroni procedures 
which control the familywise error rate (i.e., the probability of making even one false 
rejection in the set of comparisons), the Benjamini and Hochberg (BH) approach using 
the FDR criterion controls the expected proportion of falsely rejected hypotheses as a 
proportion of all rejected hypotheses. Bonferroni procedures may be considered 
conservative for large families of comparisons.’ In other words, using the Bonferroni 
method would produce more statistically nonsignificant comparisons than using the BH 
approach. Therefore, the BH approach is potentially more powerful for comparing 
Colorado to all other participating jurisdictions. A more detailed description of the 
Bonferroni and BH procedures appears in the Technical Report of the NAEP 1996 State 
Assessment Program in Mathematics. 

Statistics with Poorly Estimated Standard Errors 

Not only are the averages and percentages reported in NAEP subject to 
uncertainty, but their standard errors are as well. In certain cases, typically when the 
standard error is based on a small number of students or when the group of students is 
enrolled in a small number of schools, the amount of uncertainty associated with the 
standard errors may be quite large. Throughout this report, estimates of standard errors 
subject to a large degree of uncertainty are followed by the symbol “!”. In such cases, 
the standard errors — and any confidence intervals or significance tests involving these 
standard errors — should be interpreted cautiously. Further details concerning 
procedures for identifying such standard errors are discussed in the Technical Report of 
the NAEP 1996 State Assessment Program in Mathematics. 

Minimum Subgroup Sample Sizes 

Results for mathematics performance and background variables were tabulated and 
reported for groups defined by gender, race/ethnicity, parental education, location of the 
school, type of school, participation in federally funded Title I programs, and eligibility 
for the free/reduced-price lunch component of the National School Lunch Program. 
NAEP collects data for five racial/ethnic subgroups (White, Black, Hispanic, 
Asian/Pacific Islander, and American Indian/Alaskan Native), three types of locations 
(Central City, Urban Fringe/Large Town, and Rural/Small Town),’® and five levels of 
parents’ education (Graduated From College, Some Education After High School, 

Graduated From H igh School, Did Not Finish High School, and I Don’t Know). 

8 

Benjamini, Y. and Y. Hochberg. “Controlling the false discovery rate: A practical and powerful approach to multiple 
testing,” in Journal of the Royal Statistical Society, Series B, 57(1). (pp. 289 — 300, 1994). 

9 

Williams, V.S.L., L.V. Jones, and J.W. Tukey. Controlling Error in Multiple Comparisons, with Special Attention to the 
National Assessment of Educational Progress, (Research Triangle Park, NC: National Institute of Statistical Sciences, 
December 1994). 

Previous NAEP reports reported data for four types of communities, rather than for the three types of location. These 
types of communities were Advantaged Urban, Disadvantaged Urban, Extreme Rural, and Other types of communities. 
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In many jurisdictions, and for some regions of the country, the number of students 
in some of these groups was not sufficiently high to permit accurate estimation of 
performance and/or background variable results. As a result, data are not provided for 
the subgroups with students from very few schools or for the subgroups with very small 
sample sizes. For results to be reported for any state assessment program subgroup, 
public school results must represent at least 5 primary sampling units (PSUs) and 
nonpublic school results must represent 6 schools. For results to be reported for any 
national assessment subgroup, at least 5 PSUs must be represented in the subgroup. In 
addition, a minimum sample of 62 students per subgroup is required. For statistical tests 
pertaining to subgroups, the sample size for both groups has to meet the minimum " 
sample size requirements. 

The minimum sample size of 62 was determined by computing the sample size 
required to detect an effect size of 0.5 total-group standard deviation units with a 
probability of 0.8 or greater. The effect size of 0.5 pertains to the true difference 
between the average scale score of the subgroup in question and the average scale score 
for the total fourth- or eighth-grade public school population in the jurisdiction, divided 
by the standard deviation of the scale score in the total population. If the true difference 
between subgroup and total group mean is 0.5 total-group standard deviation units, then 
a sample size of at least 62 is required to detect such a difference with a probability 
of 0.8. Further details about the procedure for determining minimum sample size appear 
in the Technical Report of the NAEP 1996 State Assessment Program in Mathematics. 

Describing the Size of Percentages 

Some of the percentages reported in the text of the report are given qualitative 
descriptions. For example, the number of students currently taking an algebra class 
might be described as “relatively few” or “almost all,” depending on the size of the 
percentage in question. Any convention for choosing descriptive terms for the 
magnitude of percentages is to some degree arbitrary. The descriptive phrases used in 
the report and the rules used to select them are shown below. 



Percentage 


Descriptive Term Used in Report 


p = 0 


None 


0 < p < 8 


A small percentage 


8 < p < 13 


Relatively few 


13 < p < 18 


Less than one fifth 


18<p<22 


About one fifth 


22 < p < 27 


About one quarter 


27 < p < 30 


Less than one third 


30 < p < 36 


About one third 


36 < p < 47 


Less than half 


47 < p < 53 


About half 


53 < p < 64 


More than half 


64 < p < 71 


About two thirds 


71 < p < 79 


About three quarters 


79 < p < 89 


A large majority 


89 < p < 1 00 


Almost all 


p = 100 


All 



THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



179 



Colorado 



A.4 Revisions to the NAEP 1990 and 1992 Mathematics Findings 

After the NAEP 1994 assessment has been conducted, two technical problems 
were discovered in the procedures used to develop the NAEP mathematics scale and 
achievement levels determined for the 1990 and 1992 mathematics assessments. These 
errors affected the mathematics scale scores reported in 1992 and the achievement level 
results reported in 1990 mathematics scale scores reported in 1992 and the achievement 
level results reported in 1990 and 1992. The National Center for Education Statistics 
(NCES) and the National Assessment Governing Board (NAGB) have evaluated the 
impact of these errors and have reanalyzed and reported the revised results from both 
mathematics assessments. The technical errors have been corrected and the revised 
national and state scale score results for 1992 and achievement level results for 1990 
and 1992 are presented in the NAEP 1996 mathematics reports. 

Although the two technical problems that were discovered are discussed in greater 
detail in the NAEP 1996 Technical Report and NAEP 1996 Technical Report of the State 
Assessment in Mathematics, a brief summary is presented below. 

The first technical problem resulted from an error in the computer program used 
to compute NAEP scale score results. The error occurred in the convention used to 
handle omitted responses in the item response theory (IRT) scaling of the partial-credit 
constructed-response questions, and it was limited only to those questions. In Analyses 
of the NAEP 1992 response questions, and it was limited only to those questions. In 
analyses of the NAEP 1992 mathematics assessment, this error caused all blank 
responses to partial-credit constructed-response questions (both omitted and not-reached 
responses) to be treated as missing — an acceptable treatment, but not the conventional 
choice for NAEP. (Because the NAEP 1990 mathematics assessment did not include 
these types of questions, the error did not occur.) The national and state assessments 
results were recalculated using the intended convention for the treatment of omitted 
responses. 

In general, the effect of this technical problem on the previously reported NAEP 
1992 mathematics findings was minimal, and it had little impact on policy-related 
interpretations. The recalculated 1992 mathematics scale score results, at the national 
and state levels, are quite similar to those published in the 1992 mathematics reports. 
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The second technical problem involved the development of the NAEP 
mathematics achievement level cut scores, and it concerned the mapping of the 
NAGB -approved achievement levels onto the NAEP mathematics scale. This error 
affected the achievement level results reported for the 1990 and 1992 mathematics 
assessments. In deriving the final levels recommended to NAGB, panelists’ ratings for 
the multiple-choice and constructed-response questions were combined to obtain an 
overall rating for the questions. When combined, the ratings were weighted based on 
the amount of information provided by each type of question. In other words, some of 
the questions “counted more” toward the overall cut scores than others. However, 
because the weighting was carried out incorrectly, the constructed-response questions 
received more weight than intended. Therefore, the cut scores established by mapping 
the achievement levels onto the NAEP mathematics scale were incorrect, and the 
percentages of students at or above these levels were incorrectly estimated. 

The program that mapped the achievement levels to the NAEP scale was corrected 
to appropriate weight the constructed-response questions, and revised mathematics 
achievement level cut scores were developed based on the corrected scaling procedures. 
As a result, the cut scores for the three achievement levels at each grade were raised, 
and the percentages of students at or above the achievement levels were recalculated 
based on the corrected cut scores. Revised 1990 and 1992 percentages, for the national 
and state assessments, are presented in this report. 
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APPENDIX B 



The NAEP 1996 Mathematics Assessment 

TThe 1996 assessment was the first update of the NAEP mathematics assessment 
framework^ since the release of the National Council of Teachers of Mathematics 
(NCTM) Curriculum and Evaluation Standards for School Mathematics} This update 
reflected refinements in the specifications governing the development of the 1996 
assessment while assuring comparability of results across the 1990, 1992, and 1996 
assessments. The refinements that distinguish the framework of the assessment 
conducted in 1996 from the framework of the assessments conducted in 1990 and 1992 
include the following: 

• moving away from the rigid content-strand-by-cognitive-process matrix 
that governed the development of earlier assessments. Classifying 
specific questions into cells of a matrix had required those questions to 
measure a unique content strand at a unique cognitive level. This 
stipulation often decontextualized the questions and limited the 
possibility of assessing students’ abilities to reason in rich 
problem-solving situations and to make connections among content 
strands within mathematics. 

© allowing individual questions on the assessment to be classified in one 
or more content strands when appropriate. Knowledge or skills from 
more than one content strand is often needed to answer a question. The 
option to classify questions in multiple ways provides a greater 
opportunity to measure student ability in content settings that closely 
approximate real-world reasoning and problem-solving situations. 
(However, to develop content strand scales, the primary content 
classification was used for questions with multiple classifications.) 

• including the mathematics ability categories (conceptual understanding, 
procedural knowledge, and problem solving) as well as the process goals 
from the NCTM Standards (i.e., communication and connections) to 
.achieve a balance of questions that measured a range of cognitive 
outcomes. 




National Assessment Governing Board. Mathematics Framework for the 1996 National Assessment of Educational 
Progress. (Washington, DC: National Assessment Governing Board, 1994). 



2 



National Council of Teachers of Mathematics. Curriculum and Evaluation Standards for School Mathematics. (Reston, 
VA: NCTM, 1989). 
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• continuing the move towards including more constructed-response 
questions. 

• creating “families” of questions that probe a student’s understanding of 
mathematics vertically within a content strand or horizontally across 
content strands. 

• revising the number sense, properties, and operations and geometry and 
spatial sense content strands to reflect the NCTM Standards emphasis 
on developing and assessing students’ abilities to make sense of both 
number and operation and spatial settings. 

These refinements to the NAEP mathematics framework were made so that the 
1996 assessment would: (1) more adequately reflect recent curricular emphases and 
objectives and yet (2) maintain a connection with the 1990 and 1992 assessments to 
measure trends in student performance. Prior to the 1996 assessment, investigations 
were conducted to ensure that results from the assessment could be reported on the 
existing NAEP mathematics scale. The conclusion drawn from these investigations was 
that results from the 1990, 1992, and 1996 assessments could be reported on a conunon 
scale and trends in mathematics performance since 1990 examined. 

The Assessment Design 

Each student in the state assessment program in mathematics received a booklet 
containing a set of general background questions, a set of subject-specific background 
questions, and a combination of cognitive questions grouped in sets called blocks. At 
each grade level, the blocks of questions consisted of multiple-choice and 
constmcted-response questions. Two types of constmcted-response questions were 
included — short and extended constructed-response. Short constructed-response 
questions required students to provide answers to computation problems or to describe 
solutions in one or two sentences. Extended constmcted-response questions required 
students to provide longer answers (e.g., a description of possibilities, a more involved 
computational analysis, or a description of a pattern and its implications). Students were 
expected to adequately answer the short constmcted-response questions in about 2 to 3 
minutes and the extended constmcted-response questions in approximately 5 minutes. 
Short constmcted-response questions which first appeared in the assessment in 1996 
were graded to allow for partial credit (i.e., giving students credit for answers that are 
partially correct) according to a unique scoring mbric developed for each 
constmcted-response question. Short constmcted-response questions included in the 
1990 and 1992 mathematics assessments were dichotomously scored (i.e., correct or 
incorrect). The extended constmcted-response questions included in the 1992 and 1996 
assessments were scored allowing for partial credit. 
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The blocks of questions contained several other features. Five to seven of the 
blocks at each grade level allowed calculator usage. At grade 4, students were provided 
four-function calculators, and at grade 8, students were provided scientific calculators. 
Prior to the assessment, all students were trained in the use of these calculators. For 
several blocks, students were given manipulatives (including geometric shapes, 
three-dimensional models, and spinners). For two of the blocks at each grade level, 
students were given rulers (at grade 4) or rulers and protractors (at grade 8) so the 
student could answer questions dealing with measurements and draw specified geometric 
shapes. 

As part of the national assessment, other blocks of questions were developed for 
each of the grade levels. Each grade level had two estimation blocks that employed a 
paced-audiotape format to measure students’ estimation skills. Each grade level also 
had two 30-minute theme blocks consisting of a mixture of multiple-choice and 
constructed-response questions. All of the questions in these blocks related to some 
aspect of a rich problem setting that served as a unifying theme for the entire block. 
Neither the estimation nor the theme block component were included in the state 
assessment program. Results for the estimation and theme blocks will be featured in 
future reports on the NAEP 1996 mathematics assessment. 

Of the 17 blocks in the national sample at the fourth grade and the 19 blocks in 
the national sample at the eighth grade, 3 were carried forward from the 1990 assessment 
and 5 were carried forward from the 1992 assessment to allow for the measurement of 
trends across time. The remaining blocks of questions at each grade level contained new 
questions developed for the 1996 assessment as specified by the updated framework. 

The data in Table B.l reflect the number of questions by type by grade level for 
the 1990, 1992, and 1996 assessments. As mentioned earlier, the 1996 assessment 
continued NAEP’s shift toward more constructed-response questions, including extended 
constructed-response questions that required students to provide an answer and a 
corresponding explanation. 
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TABLE B.1 


Distribution of Questions by Question Type 


State Assessment 



Grade 4 


Grade 8 


Grade 12 


1990 


1992 


1996 


1990 


1992 


1996 


1990 


1992 


1996 



Multiple-Choice 


102 


99 


81 


149 


118 


102 


156 


115 


99 


Short Constructed-Response* 


41 


59 


64 


42 


65 


69 


47 


64 


74 


Extended Constructed-Response** 


... 


5 


13 


... 


6 


12 


... 


6 


11 


Total 


143 


163 


158 


191 


189 


183 


203 


185 


184 



* Short constructed-response questions included in the 1990 and 1992 assessments were scored dichotomously. New 
short constructed-response questions included in the 1996 assessment were scored to allow for partial credit. 

*♦ No extended constructed-response questions were included in the 1990 assessment. 



Each booklet in the state assessment program included three sets of student 
background questions. The first, consisting of general background questions, included 
questions about race or ethnicity, mother’s and father’s level of education, reading 
materials in the home, homework, attendance, and academic expectations. The second 
set, consisting of mathematics background questions, included questions about 
instructional activities, courses taken, use of specialized resources such as calculators in 
mathematics classes, and views on the utility and value of the subject. (Students were 
given 5 minutes to complete each set of questions, with the exception of the fourth 
graders, who were given more time because the general background questions were read 
aloud to them.) The third set of questions followed the cognitive question blocks and 
contained five questions about students’ motivation to do well on the assessment, their 
perception of the difficulty of the assessment, and their familiarity with the types of 
cognitive questions included. 

The blocks of cognitive and background questions were carefully balanced to 
ensure that the blocks could be completed within the time provided to the students, using 
information gathered from the field test. For more information on the design of the 
assessment, the reader is referred to Appendix C. 
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APPENDIX C 



Technical Appendix: The Design, 
Implementation, and Analysis of the 1996 
State Assessment Program in Mathematics 



C.1 Overview 

The purpose of this appendix is to provide technical information about the 1996 
state assessment program in mathematics. It provides a description of the design for the 
assessment and gives an overview of the steps involved in the implementation of the 
program from the planning stages through to the analysis of the data. 

This appendix is one of several documents that provide technical information 
about the 1996 state assessment program. Those interested in more details are referred 
to the forthcoming Technical Report of the NAEP 1996 State Assessment Program in 
Mathematics. Theoretical information about the models and procedures used in NAEP 
can be found in the special NAEP-related issue of the Journal of Educational Statistics 
(Summer 1992A^olume 17, Number 2) as well as previous national technical reports. 

Educational Testing Service (ETS) was awarded the cooperative agreement for the 
1996 NAEP programs, including the state assessment program. ETS was responsible 
for overall management of the programs as well as for development of the overall 
design, the cognitive questions and questionnaires, data analysis, and reporting. National 
Computer Systems (NCS) was a subcontractor to ETS on both the national and state 
NAEP programs. NCS was responsible for printing, distribution, and receipt of all 
assessment materials, and for scanning and professional scoring. All aspects of sampling 
and field operations for both the national and state assessment programs were the 
responsibility of Westat, Inc. NCES awarded a separate cooperative agreement to 
Westat for these services for the national and state assessments. 
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Orgainization of the Technical Appendix 

This appendix provides a brief description of the design for the state assessment 
program in mathematics and gives an overview of the steps involved in implementing 
the program from the planning stages to the analysis of the data. (A more detailed 
discussion of the technical aspects of the NAEP state assessment program can be found 
in the forthcoming Technical Report of the NAEP 1996 State Assessment Program in 
Mathematics.) The organization of this appendix is as follows: 

® Section C.2 provides an overview of the design of the 1996 state 
assessment program in mathematics. 

o Section C.3 discusses the balanced incomplete block (BIB) spiral design 
that was used to assign cognitive questions to assessment booklets and 
assessment booklets to students. 

© Section C.4 outlines the sampling design used for the 1996 state 
assessment program. 

• Section C.5 summarizes Westat’s field administration procedures. 

o Section C.6 describes the flow of the data from their receipt at NCS 
through data entry and professional scoring. 

• Section C.7 summarizes the procedures used to weight the assessment 
data and to obtain estimates of the sampling variability of subpopulation 
estimates. 

• Section C.8 describes the initial analyses performed to verify the quality 
of the data. 

• Section C.9 describes the item response theory scales and the overall 
mathematics composite scale that were created for the final analyses of 
the state assessment program data. 

© Section C.IO provides an overview of the linking of the scaled results 
from the state assessment program in mathematics to those from the 
national assessment. 

C.2 Oesogn of the NAEP 1996 State Assessment Program in 

lyiathematDcs 

The major aspects of the design for the state assessment program in mathematics 
included the following: 

o Participation at the jurisdiction level was voluntary. 

o Fourth- and eighth-grade students from public and nonpublic schools 
were assessed. Nonpublic schools included Catholic schools, other 
religious schools, private schools. Department of Defense Domestic 
Elementary and Secondary Schools (DDESS), and Bureau of Indian 
Affairs schools. Sepzu’ate representative samples of public and 
nonpublic schools were selected in each participating jurisdiction and 
students were randomly sampled within schools. The size of a 
jurisdiction’s nonpublic school samples was proportional to the 
percentage of students in that jurisdiction attending such schools. 
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• The fourth- and eighth-grade mathematics assessment instmments used 

for the state assessment program and the national assessment consisted 
of 13 blocks of questions. Eight of these blocks were previously 
administered as part of the 1990 and 1992 national and Trial State 
Assessments. The type of questions — constructed-response or 
multiple-choice — was determined by the nature of the task. In addition, 
the constmcted-response questions were of two types: short 

constructed-response questions required students to provide answers to 
computation problems or to describe solutions in one or two sentences, 
while extended constructed-response questions required students to 
provide longer responses when answering the question. Each student 
was given 3 of the 13 blocks of questions. 

• A complex form of matrix sampling called a balanced incomplete block 
(BIB) spiraling design was used. With BIB spiraling, students in an 
assessment session received different booklets, which provided for 
greater mathematics content coverage than would have been possible 
had every student been administered the identical set of questions, 
without imposing an undue testing burden on the student. 

• Background questionnaires given to the students, the students’ 
mathematics teachers, and the principals or other administrators 
provided a variety of contextud information. The background 
questionnaires for the state assessment program were identical to those 
used in the national fourth- and eighth-grade assessments. 

• The total assessment time for each student was approximately one hour 
and 40 minutes. Each assessed student was assigned a mathematics 
booklet that contained two 5-minute background questionnaires, 
followed by 3 of the 13 blocks of mathematics questions requiring 15 
minutes each, and a 3-minute motivation questionnaire. Twenty-six 
different booklets were assembled. 

• The assessments were scheduled to take place in the five-week period 
between January 29 and March 4, 1996. One-fourth of the schools in 
each jurisdiction were to be assessed each week throughout the first four 
weeks; however, due to the severe weather throughout much of the 
country, the fifth week was used for regular testing as well as for 
makeup sessions. 

• Data collection was, by law, the responsibility of each participating 
jurisdiction. Security and uniform assessment administration were high 
priorities. Extensive training of state assessment personnel was 
conducted to assure that the assessment would be administered under 
standard, uniform procedures. For jurisdictions that had participated in 
previous NAEP state assessments, 25 percent of both public and 
nonpublic school assessment sessions were monitored by the Westat 
staff. For the jurisdictions new to NAEP, 50 percent of both public and 
nonpublic school sessions were monitored. 
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C.3 Assessmeolt Dos^rumente 

The assembly of cognitive questions into booklets and their subsequent assignment 
to assessed students was determined by a BIB design with spiraled administration. This 



was divided into 13 unique blocks, each requiring 15 minutes for completion. Each 
assessed student received a booklet containing 3 of the 13 blocks according to a design 
that ensured that each block was administered to a representative sample of students 
within each jurisdiction. 

In addition to the student assessment booklets, three other instruments provided 
data relating to the assessment — a mathematics teacher questionn 2 iire, a school 
characteristics and policies questionnaire, and an SD/LEP student questionnaire. 

The student assessment booklets contained five sections and included both 
cognitive and noncognitive questions. In addition to three 15-minute sections of 
cognitive questions, each booklet included two 5-minute sets of general and mathematics 
background questions designed to gather contextual information about students, their 
experiences in mathematics, and their attitudes toward the subject, and one 3-minute 
section of motivation questions designed to gather information about the student’s level 
of motivation while taking the assessment. 

The teacher questionnaire was administered to the mathematics teachers of the 
fourth- and eighth-grade students participating in the assessment. The questionnaire 
consisted of three sections and took approximately 20 minutes to complete. The first 
section focused on the teacher’s general background and experience; the second, on the 
teacher’s background related to mathematics; and the third, on classroom information 
about mathematics instruction. 

The school characteristics and policies questionnaire was given to the principal 
or other administrator in each participating school and took about 20 minutes to 
complete. The questions asked about the principal’s background and experience, school 
policies, programs, and facilities, and the demographic composition and background of 
the students and teachers. 

The SD/LEP student questionnaire was completed by the staff member most 
familiar with any student selected for the assessment who was classified in either of two 
ways: students with disabilities (SD) had an Individualized Education Plan (lEP) of 
equivalent special education plan (for reasons other than being gifted and talented); 
students with limited English proficiency were classified as LEP students. The 
questionnaire took approximately three minutes to complete and asked about the student 
and the special programs in which the student participated. It was completed for all 
selected SD or LEP students regardless of whether or not they participated in the 
assessment. Selected SD or LEP students participated in the assessment if they were 
determined by the school to be able to participate, considering the terms of their lEP 
and accommodations provided by the school or by NAEP. 



design is a variant of a matrix sampling design. The full set of mathematics questions 
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C.4 The Sampling Design 

The sampling design for NAEP is complex, in order to minimize burden on 
schools and students while maximizing the utility of the data; for further details see the 
forthcoming Technical Report for the NAEP 1996 State Assessment Program in 
Mathematics. The target populations for the state assessment program in mathematics 
consisted of fourth- and eighth-grade students enrolled in either public or nonpublic 
schools. The representative samples of public school fourth and eighth graders assessed 
in the state assessment program came from about 100 schools (per grade) in most 
jurisdictions. However, if a jurisdiction had fewer than 100 public schools with a 
particular grade, all or almost all schools were asked to participate. If a jurisdiction had 
smaller numbers of students in each school than expected, more than 100 schools were 
selected for participation. The nonpublic school samples differed in size across the 
jurisdictions, with the number of schools selected proportional to the nonpublic school 
enrollment within each jurisdiction. Typically, about 20 to 25 nonpublic schools (per 
grade) were included for each jurisdiction. The school sample in each jurisdiction was 
designed to produce aggregate estimates for the jurisdiction and for selected 
subpopulations (depending upon the size and distribution of the various subpopulations 
within the jurisdiction) and also to enable comparisons to be made, at the jurisdiction 
level, between administration of assessment tasks with monitoring and without 
monitoring. The public schools were stratified by urbanization, percentage of Black and 
Hispanic students enrolled, and median household income within the ZIP code area of 
the school. The nonpublic schools were stratified by type of control (Catholic, 
private/other religious, other nonpublic), metropolitan status, and enrollment size per 
grade. 

The national and regional results presented in this report are beised on nationally 
representative samples of fourth- and eighth-grade students. The samples were selected 
using a complex multistage sampling design involving the sampling of students from 
selected schools within selected geographic areas across the country. The seunple design 
had the following stages: 

(1) selection of geographic areas (a county, group of counties, or metropolitan 
statistical area) 

(2) selection of schools (public and nonpublic) within the selected areas 

(3) selection of students within selected schools 

Each selected school that participated in the assessment, and each student assessed, 
represent a portion of the population of interest. To make valid inferences from student 
samples to the respective populations from which they were drawn, sampling weights 
are needed. Discussions of sampling weights and how they are used in analyses are 
presented in sections C.7 and C.8. 




THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



191 



Colorado 



er|c 



The state results provided in this report are based on state-level samples of fourth- 
and eighth-grade students. The samples of both public and nonpublic school s;tudents 
were selected based on a two-stage sample design that entailed selecting students within 
schools. The first-stage samples of schools were selected with a probability proportional 
to the fourth- or eighth-grade enrollment in the schools. Special procedures were used 
for jurisdictions with many small schools and for jurisdictions with a small number of 
schools. As with the national samples, the state samples were weighted to allow for 
valid inferences about the populations of interest. 

The results presented for a particular jurisdiction are based on the representative 
sample of students who participated in the 1996 state assessment program. The results 
for the nation and regions, of the country are based on the nationally and regionally 
representative samples of students who were assessed as part of the national NAEP 
program. Using the national and regional results from the 1996 national assessment 
was necessary because of the voluntary nature of the state assessment program. Because 
not every state participated in the program, the aggregated data across states did not 
necessarily provide representative national or regional results. 

In most jurisdictions, up to 30 students were selected from each school, with the 
aim of providing an initial sample size of approximately 3,000 public school students 
per jurisdiction per grade. The student sample size of 30 for each school was chosen 
to ensure that at least 2,000 public school students (per grade) participated from each 
jurisdiction, allowing for school nonresponse, exclusion of students, inaccuracies in the 
measures of enrollment, and student absenteeism from the assessment. In jurisdictions 
with fewer schools, larger numbers of students per school were often required to ensure 
initial samples of roughly 3,000 students. In certain jurisdictions, all eligible fourth or 
eighth graders were targeted for assessment. Jurisdictions were given the option to 
reduce the expected student sample size in order to reduce testing burden and the number 
of multiple-testing sessions for participating schools. At grade 4, two jurisdictions 
(Delaware and Guam) and at grade 8, four jurisdictions (Alaska, Delaware, Hawaii, and 
Rhode Island) elected to exercise this option. Using this option can involve 
compromises such as higher standard errors and accompanying loss of precision. 

In order to provide for wider inclusion of students with disabilities and limited 
English proficiency, the 1996 state assessments in mathematics involved dividing the 
sample of students at each grade level into two subsamples, referred to as SI and S2. 
SI provided continuity with the 1992 mathematics assessment and thus allowed for the 
reporting of performance over time by using the same exclusion criteria for students 
with disabilities and limited English proficiency as was used in that assessment. S2 
provided for wider inclusion of students with disabilities and limited English proficiency 
by incorporating new exclusion rules. For further discussion, see the NAEP 1996 
Mathematics Report Card. The 1996 national assessment in mathematics involved an 
additional subsample, S3, in which accommodations were provided for certain students 
with disabilities or limited English proficiency, again in order to make NAEP more 
inclusive. 
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For both the national and state mathematics assessments, scaling and analysis 
procedures (discussed in sections C.8 to C.IO) were applied to a combination of students 
from SI and S2. Specifically, all assessed students from SI were combined with those 
students from S2 who were not identified as SD or LEP. This combination of segments 
of the SI and S2 subsamples provided for maximizing the use of available data while 
allowing for comparisons to the student population in the national sample. This 
combination, referred to as the “reporting sample,” was the sample used in linking the 
state assessment to the national assessment (see Section C.IO). 

Additional analyses will be conducted on the national samples in order to study 
the effects of changing the exclusion rules and the presence of accommodations. 
Preliminary discussion can be found in the NAEP 1996 Mathematics Report Card and 
more detailed discussion will follow in future NAEP publications. 

C.5 Field Administration 

The administration of the 1996 program required collaboration between staff in 
the participating jurisdictions and schools and the NAEP contractors, especially Westat, 
the field administration contractor. 

Each jurisdiction volunteering to participate in the 1996 state assessment program 
was asked to appoint a state coordinator as liaison between NAEP staff and the 
participating schools. In addition, Westat hired and trained a supervisor for each 
jurisdiction and six field managers, each of whom was assigned to work with groups 
of jurisdictions. The state supervisors were responsible for working with the state 
coordinators, overseeing assessment activities, training school district personnel to 
administer the assessment, and coordinating the quality-control monitoring efforts. Each 
field manager was responsible for working with the state coordinators of seven to eight 
jurisdictions and for the supervision of the state supervisors assigned to those 
jurisdictions. An assessment administrator was responsible for preparing for and 
conducting the assessment session in one or more schools. These individuals were 
usually school or district staff and were trained by Westat. Westat also hired and trained 
three to five quality control monitors in each jurisdiction. For jurisdictions that had 
previously participated in the state assessment program, 25 percent of the public and 
nonpublic school sessions were monitored. For jurisdictions new to the program, 50 
percent of all sessions were monitored. The assessment sessions were conducted during 
a five- week period beginning in late January 1996. 
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C.6 Materials Processing, Professional Scoring, and Database 
Creation 

Upon completion of each assessment session, school personnel shipped the 
assessment booklets and forms to NCS for professional scoring, entry into computer 
files, and checking. The files were then sent to ETS for creation of the database. 

After NCS received all appropriate materials from a school, they were forwarded 
to the professional scoring area where the responses to the constructed-response question 
were evaluated by trained staff using guidelines prepared by ETS. Each 
constructed-response question had a unique scoring guide that defined the criteria to be 
used in evaluating students’ responses. The extended constructed-response questions 
were evaluated with four- or five-level rubrics, and the short constructed-response 
questions first used in 1996 were rated according to three-level rubrics that permit partial 
credit to be given. Short constructed-response questions used previously were scored 
dichotomously (i.e., correct or incorrect). 

For the national mathematics assessment and the state assessment program in 
mathematics, over 4.8 million constructed responses were scored. This figure includes 
rescoring to monitor inter-rater reliability and trend reliability. In other words, scoring 
reliability was calculated both within year (1996) and across years (1990, 1992, and 
1996). The overall within-year percentages of agreement for the 1996 national 
within-year reliability samples were 96 percent at grade 4 and 96 percent at grade 8. 
The percentages of agreement across the assessment years for the national inter-year 
reliability samples were 96 percent (1990 to 1996) and 94 percent (1992 to 1996) at 
grade 4 and 95 percent (1990 to 1996) and 94 percent (1992 to 1996) at grade 8. 

Data transcription and editing procedures were used to generate the disk and tape 
files containing various assessment information, including the sampling weights required 
to make valid statistical inferences about the population from which the state assessment 
program sample was drawn. Prior to analysis, the data from these files underwent a 
quality control check at ETS. The files were then merged into a comprehensive, 
integrated database. 
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C.7 Weighting and Variance Estimation 

A complex sample design was used to select the students to be assessed in each 
of the participating jurisdictions. The properties of a sample from a complex design are 
very different from those of a simple random sample in which every student in the target 
population has an equal chance of selection and in which the observations from different 
sampled students can be considered to be statistically independent of one another. The 
properties of the sample from the complex state assessment program design were taken 
into account in the analysis of the assessment data. 

One way that the properties of the sample design were addressed was by using 
sampling weights to account for the fact that the probabilities of selection were not 
identical for all students. These weights also included adjustments for school and 
student nonresponse. All population and subpopulation characteristics based on the state 
assessment program data used sampling weights in their estimation. 

In addition to deriving appropriate estimates of population characteristics, it is 
essential to obtain appropriate measures of the degree of uncertainty of those statistics. 
One component of uncertainty results from sampling variability, which is a measure of 
the dependence of the results on the particular sample of students actually assessed. 
Because of the effects of cluster selection (schools are selected first, then students are 
selected within those schools), observations made on different students cannot be 
assumed to be independent of each other (and, in fact, are generally positively 
correlated). As a result, classical variance estimation formulas will produce incorrect 
results. Instead, a jackknife variance estimation procedure that takes the characteristics 
of the sample into account was used for all analyses. 

Jackknife variance estimation provides a reasonable measure of uncertainty for any 
statistic based on values observed without error. Statistics such as the percentage of 
students correctly answering a given question meet this requirement^ but other statistics 
based on estimates of student mathematics performance, such as the average 
mathematics scale score of a subpopulation, do not. Because each student typically 
responds to relatively few questions from a particular content strand (e.g.. Algebra and 
Functions or Geometry and Spatial Sense) there exists a nontrivial amount of 
imprecision in the measurement of the scale score of a given student. This imprecision 
adds an additional component of variability to statistics based on estimates of individual 
scale scores. 
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C.8 Preliminary Data Analysis 

After the computer files of student responses were received from NCS and merged 
into an integrated database, all cognitive and noncognitive questions were subjected to 
an extensive item analysis. For each question, this analysis yielded the number of 
respondents, the percentage of responses in each category, the percentage who omitted 
the question, the percentage who did not reach the question, and the correlation between 
the question score and the block score. In addition, the item analysis program provided 
summary statistics for each block, including a reliability (internal consistency) 
coefficient. These analyses were used to check the scoring of the questions, to verify 
the appropriateness of the difficulty level of the questions, and to check for speededness. 
The results were reviewed by knowledgeable project staff in search of aberrations that 
might signal unusual results or errors in the database. 

The question and block-level analyses were done using rescaled versions of the 
final sampling weights provided by Westat (see Section C.7). The rescaling was carried 
out within each jurisdiction. The sum of the sampling weights for the public school 
students within each jurisdiction was constrained to be equal. The same transformation 
was then applied to the weights of the nonpublic school students in that jurisdiction. 
The sum of the weights for each of the DoDEA samples (i.e., DDESS and DoDDS) was 
constrained to be equal to the same value as the public school students in other 
jurisdictions. Use of rescaled weights does nothing to alter the value of statistics 
calculated separately within each jurisdiction. However, for statistics obtained from 
samples that combine students from different jurisdictions, use of the rescaled weights 
results in a roughly equal contribution of each jurisdiction's data to the final value of the 
estimate. Equal contribution of each jurisdiction's data to the results of the item response 
theory (IRT) scaling was viewed as a desirable outcome. The original final sampling 
weights provided by Westat were used in reporting. 

Additional analyses comparing the data from the monitored sessions with those 
from the unmonitored sessions were conducted to determine the comparability of the 
assessment data from the two types of administrations. Differential item functioning 
(DIF) analyses were earned out using the national assessment data. DIF analyses 
identify questions that were differentially difficult for various subgroups, affording the 
opportunity to reexamine such questions with respect to their fairness and their 
appropriateness for inclusion in the scaling process. 
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C.9 Scaling the Assessment Questions 

The primary analysis and reporting of the results from the state assessment 
program used item response theory (IRT) scale-score models. Scaling models quantify 
a respondent’s tendency to provide correct answers to the domain of questions 
contributing to a scale as a function of a parameter called performance, estimated by a 
scale score. The scale scores can be viewed as a summary measure of performance 
across the domain of questions that make up the scale. Three distinct IRT models were 
used for scaling; 1) 3-parameter logistic models for multiple-choice questions; 2) 
2-parameter logistic models for short constructed-response questions that were scored 
correct or incorrect; and 3) generalized partial credit models for short and extended 
constructed-response questions that were scored on a multipoint (i.e., greater than two 
levels) scale. 

Five distinct scales were created for the state assessment program in mathematics 
to summarize fourth- and eighth-grade students’ abilities according to the five defined 
content strands (Number Sense, Properties, and Operations; Measurement; Geometry and 
Spatial Sense; Data Analysis, Statistics, and Probability; and Algebra and Functions). 
These scales were defined identically to, but separately from, those used for the scaling 
of the national NAEP fourth- and eighth-grade mathematics data. Although the 
questions comprising each scale were identical to those used in the national assessment 
program, the item parameters for the state assessment program scales were estimated 
from combined public school data from the jurisdictions participating in the state 
assessment program.' Item parameter estimation was carried out on an item calibration 
subsample. The calibration subsample consisted of an approximately 25 percent sample 
of all available public school data. To ensure equal representation in the scaling process, 
each jurisdiction contributed the same number of students to the item calibration sample. 
Within each jurisdiction, 50 percent of the calibration sample was taken from monitored 
administrations and the other 50 percent came from unmonitored administrations. 

The fit of the IRT model to the observed data was examined within each scale 
by comparing the estimates of the empirical item characteristic functions with the 
theoretic curves. For correct-incorrect questions, nonmodel-based estimates of the 
expected proportions of correct responses to each question for students with various 
levels of scale proficiency were compared with the fitted item response curve; for the 
short and extended partial-credit constructed-response questions, the comparisons were 
based on the expected proportions of students with various levels of scale proficiency 
who achieved each score level. In general, the question-level results were well fit by 
the scaling models. 



Schools from the DoDEA jurisdictions were not included in the item calibration san^le. 
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Using the item parameter estimates, estimates of various population statistics were 
obtained for each jurisdiction. The NAEP methods use random draws (“plausible 
values ) from estimated proficiency distributions for each student to compute population 
statistics. Plausible values are not optimal estimates of individual student proficiencies; 
instead, they serve as intermediate values to be used in estimating population 
characteristics. Under the assumptions of the scaling models, these population estimates 
will be consistent, in the sense that the estimates approach the model-based population 
values as the sample size increases, which would not be the case for population estimates 
obtained by aggregating optimal estimates of individual performance. 

In addition to the plausible values for each scale, a composite of the five content 
strand scales was created as a measure of overall mathematics proficiency. This 
composite was a weighted average of the five mathematics scales in which the weights 
were proportional to the relative importance assigned to each content strand in the 
mathematics framework. The definition of the composite for the state assessment 
program was identical to that used for the national fourth- and eighth-grade mathematics 
assessments. 

C.10 Unkir^g the State Results to the National Results 

A major purpose of the state assessment program was to allow each participating 
jurisdiction to compare its 1996 results with those for the nation as a whole and with 
those for the region of the country in which that jurisdiction is located. For meaningful 
comparisons to be made between each jurisdiction and the relevant national sample, 
results from these two assessments had to be expressed in terms of a similar system of 
scale units. 

The results from the state assessment program were linked to those from the 
national assessment through linking functions determined by comparing the results for 
the aggregate of all students assessed in the state assessment program with the results 
for students of the matching grade within the National Linking Sample of the national 
NAEP. The National Linking Sample of the national NAEP for a given grade is a 
representative sample of the population of all grade-eligible public school students 
within the aggregate of 45 participating states and the District of Columbia. Guam and 
the two Department of Defense Education Activity (DoDEA) jurisdictions were not 
included in the aggregate. Specifically, the fourth- and eighth-grade National Linking 
Samples consist of all fourth- and eighth-grade students in public schools in the states 
and the District of Columbia who were assessed in the national cross-sectional 
mathematics assessment. 
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For each grade, a linear equating within each scale was used to link the results 
of the state assessment program to the national assessment. For each scale, the adequacy 
of the linear equating was evaluated by comparing the distribution of mathematics scale 
scores based on the aggregation of all assessed students at each grade from the 
participating states and the District of Columbia. with the equivalent distribution based 
on the students in the National Linking Sample. In the estimation of these distributions, 
the students were weighted to represent the target population of public school students 
in the specified grade in the aggregation of the states and the District of Columbia. If 
a linear equating were adequate, the distribution for the aggregate of states and the 
District of Columbia and that for the National Linking Sample will have, to a close 
approximation, the same shape in terms of the skewness, kurtosis, and higher moments 
of the distributions. The only differences in the distributions allowed by linear equating 
are in the means and variances. Generally, this has been found to be the case. 

Each mathematics content- strand scale was linked by matching the mean and 
standard deviation of the scale scores across all students in the state assessment 
(excluding Guam and the two DoDEA jurisdictions) to the corresponding scale mean 
and standard deviation across all students in the National Linking Sample. 



197 



THE NAEP 1996 STATE ASSESSMENT IN MATHEMATICS 



199 



Colorado 



APPENDIX D 



Setting the Achievement Levels 

S etting achievement levels is a test-centered method for setting standards on the 
NAEP assessment that identifies what students should know and should be able to do. 
The method depends on securing and summarizing a set of judgmental ratings of 
expectations for student educational performance on specific questions comprising the 
NAEP mathematics assessment. The NAEP mathematics scale is a numerical index of 
students’ performance in mathematics ranging from 0 to 500. The three achievement 
levels — Basic, Proficient, anid Advanced — are mapped onto the scale for each grade 
level assessed. 

The NAEP mathematics achievement levels were set following the 1990 
assessment and further refined following the 1992 assessment. In developing the 
threshold values for the levels, a broadly constituted panel of Judges — including 
teachers (50%), non-teacher educators (20%), and the general public 
(noneducatOrs)' (30%) — rated a grade-specific item pool using the policy definitions 
of the National Assessment Governing Board (NAGB) for Basic, Proficient, and 
Advanced. The policy definitions were operationalized by the Judges in terms of specific 
mathematical skills, knowledge, and behaviors that were Judged to be appropriate 
expectations for students in each grade and were in accordance with the current 
mathematics assessment framework. The policy definitions are as follows: 

Basic 

This level denotes partial mastery of the prerequisite knowledge and 
skills that are fundamental for proficient work at each grade. 

Proficient 

This level represents solid academic performance for each grade 
assessed. Students reaching this level have demonstrated competency 
over challenging subject matter and are well prepared for the next level 
of schooling. 



Advanced 

This higher level signifies superior performance beyond proficient 
grade-level mastery at each grade. 



Noneducators represented business, labor, government service, parents, and the general public. 
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The judges’ operationalized definitions were incorporated into lists of descriptors 
that represent what borderline students should be able to do at each of the levels defined 
by policy. The purpose of having panelists develop their own operational definitions 
of the achievement levels was to ensure that all panelists would have a common 
understanding of borderline performances and a common set of content-based referents 
to use during the item-rating process. 

The judges (24 at grade 4 and 22 at grade 8) each rated half of the questions in 
the NAEP pool in terms of the expected probability that a student at a borderline 
achievement level would answer the question correctly, based on the judges’ 
operationalization of the policy definitions and the factors that influence question 
difficulty. To assist the judges in generating consistently scaled ratings, the rating 
process was repeated twice, with feedback. Information on consistency among different 
judges and on the difficulty of each question^ was fed back into the first repetition 
(round 2), while information on consistency within each judge’s set of ratings was fed 
back into the second repetition (round 3). The third round of ratings permitted the 
judges to discuss their ratings among themselves to resolve problematic ratings. The 
mean final rating of the judges aggregated across questions yielded the threshold values 
in the percent correct metric. These cut scores were then mapped onto the NAEP scale 
(which is defined and scored using item response theory, rather than percent correct) to 
obtain the scale scores for the achievement levels.^ The judges’ ratings, in both metrics, 
and their associated errors of measurement are shown below. NAGB accepted the 
panel’s achievement levels and, for reporting purposes, set final outpoints one standard 
error (a measure of consistency among the judges’ ratings) below the mean levels. 
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FIGURE D.1 




StatB Assessment 



Cutpoints for Achievement Levels at Grades 4 and 8 



Grade 


Level 


Mean Percent 
Correct 
(Round 3) 


Scale Score* 


Standard 
Error of 
Scale Score** 


4 


Basic 


39 


214 


1.9 


4 


Proficient 


65 


249 


4.1 


4 


Advanced 


84 


282 


4.0 


8 


Basic 


48 


262 


2.4 


8 


Proficient 


71 


299 


5.7 


8 


Advanced 


87 


333 


4.8 



* Scale score is derived from a weighted average of the mean percent correct for multiple-choice and short 
constnicted-response questions after both were mapped onto the NAEP scale. 

** The standard error of the scale score is estimated ftom the difference in mean scale scores for the two equivalent 
subgroups of judges. 



2 

Item difficulty estimates were based on a preliminary, partial set of responses to the national assessment. 

^ See Appendix A for a discussion of the technical errors that resulted in the reanalysis and rereporting of 1990 and 1992 
mathematics achievement level results. 
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After the ratings were completed, the judges for each grade level reviewed the 
operationalized descriptions developed by the judges of the other grade levels as well 
as their own descriptions and defined achievement level descriptions that were generally 
acceptable to all three grade-group judges. However, the descriptions varied in format, 
sharpness of language, and degree of specificity of the statements. Therefore, another 
panel at a subsequent validation meeting improved the wording and modified the 
language of the achievement level descriptions to reflect more closely the terminology 
of the National Council of Teachers of Mathematics Curriculum and Evaluation 
Standards for School Mathematics.'' The achievement level descriptions, though based 
on the 1992 NAEP pool, apply to the current assessment and will not change from 
assessment to assessment (that is, until the framework changes). 

Figure 3.1 in Chapter 3 provides the detailed descriptions of the three achievement 
levels for grades 4 and 8. In addition, exemplar questions are presented to illustrate each 
level. 




^ National Council of Teachers of Mathematics. Curriculum and Evaluation Standards for School Mathematics. (Reston, 
VA: NCTM, 1989). 
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APPENDIX E 



Teacher Preparation 

eacheis are key to improving mathematics learning, and so it is important to 
examine their background and professional development. Fourth- and eighth-grade 
mathematics teachers completed questionnaires concerning their background and 
training, including their experience, certification, undergraduate and graduate course 
work in mathematics, and involvement in pre-service education. 

Consistent with procedures used throughout this report, the student was the unit 
of analysis. That is, the mathematics teachers’ responses were linked to their students, 
and the data reported are the percentages of students taught by teachers with particular 
characteristics. 
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TABLE E.1A- GRADE 4 


CARD 




I 


Public School Teachers’ Reports on Their Highest Level of 


State Assessment 


Education 



What is the highest academic degree 
you hoid? 


Colorado 


West 


Nation 


Percentage of Students 




Bachelor’a degree 


1992 


53(3.1) 


60 ( 3.6) 


53 ( 2.4) 




1996 


54 ( 4.0) 


73 ( 3.1) 


60 ( 2.8) 


Master’s degree 


1992 


44 ( 3.4) 


38 ( 3.5) 


41 ( 2.4) 




1996 


39 ( 3.8) 


22 ( 2.8)< 


32 ( 2.3)< 


Education specialiat’s or 










professional diploma 


1992 


2 ( 0.8) 


2(1.0) 


6( 1.2) 




1996 


5( 1.3) 


5(1.5) 


8(1.2) 


Doctorate or professional degree 


1992 


1 ( 0.5) 


0 (•**•) 


0 ( 0.3) 




1996 


2( 1.0) 


1 (0.1) 


0 ( 0.0) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estinwtes, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 
at about the 95 percent confidence level. **** Standard error estimates cannot be accurately determined. 

SOURCE: Nauonal Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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TABLE E.1B - GRADE 8 


Public School Teachers’ Reports on Their Highest Level of 
Education 


state Assessment 



What is the highest academic degree 


Colorado 


West 


Nation 


you hoid? 


Percentage of Students 



Bachelor’s degree 


1990 


50 ( 3.3) 


68 ( 5.2) 


56 1 


(4.2) 




1992 


50 ( 3.1) 


64 ( 4.5) 


531 


(2.9) 




1996 


55 ( 3.7) 


74 ( 4.6) 


591 


(3.4) 


Master’s degree 


1990 


42(3.1) 


31 (5.1) 


35 1 


(4.3) 




1992 


46 ( 3.3) 


33 ( 3.9) 


41 1 


(2.7) 


Education specialist’s or 


1996 


40 ( 3.5) 


23 ( 4.9) 


35 < 


[3.2) 


professional diploma 


1990 


7(1.8) 


1 ( 0.7) 


6 { 


: 1.8) 




1992 


4(1.2) 


2(1.2) 


6{ 


: 1.3) 




1996 


4( 1.5) 


2 (••••) 


5( 


: 1.2) 


Doctorate or professional degree 


1990 


1 r**) 


0 (••••) 


2( 


; 1 .4) 




1992 


1 rn 


1 (••••) 


0 ( 


; 0.3) 




1996 


0 (****) 


1 (••••) 


1 ( 


:o.4) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the s^ple. In 
comparing two estinwtes, one must use the standard error of the difference (see Appendix A for details). If the notation 
» («) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1990 
at about the 95 percent confidence level. If the notation > (<) appears, it signifies that the value for public school students 
was sigmficantly higher (lower) than the value for 1992 at about the 95 percent confidence level. **** Standard error 
estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990 1992 
and 1996 Mathematics Assessments. 
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TABLE E.2 - GRADES 4 AND 8 


Public School Teachers’ Reports on Their Undergraduate 
Majors 


State Assessment 





What were your undergraduate major 
fields of study? 


Colorado 


West 


Nation 


Percentage of Students 











GRADE 4 








Education 


90 ( 1.6) 


77 ( 3.2) 


88 ( 1 .5) 


Mathematics 


2 ( 0.9) 


7 ( 2.6) 


7(1.4) 


Mathematics Education 


3(1.0) 


5(1.9) 


6(1.2) 


Special Education 


7(1.6) 


9 ( 2.6) 


8(1.5) 


ESL 


3 ( 0.9) 


5 ( 2.0) 


3 ( 0.9) 


Other 


36 ( 2.8) 


52 ( 3.9) 


37 ( 2.5) 


GRADE 8 








Education 


60(3.1) 


45 ( 4.2) 


59 ( 3.2) 


Mathematics 


54 ( 3.5) 


40 ( 4.2) 


47 ( 3.0) 


Mathematics Education 


28 ( 3.5) 


20 ( 3.2) 


23 ( 2.9) 


Special Education 


1 ( 0.8) 


0 ( 0.2) 


1 ( 0.4) 


ESL 


0 (****) 


0 (****) 


0 ( 0.2) 


Other 


37 ( 3.5) 


53 ( 4.8) 


37 ( 3.3) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). **** Standard 
error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 
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TABLE E.3 - GRADES 4 AND 8 


Public School Teachers’ Reports on Their Graduate Majors 


State Assessment 





What were your graduate major fields 
of study? 


Colorado 


West 


Nation 


Percentage of Students 











GRADE 4 








Education 


54 ( 3.4) 


53 ( 4.2) 


59 ( 2.7) 


Mathematics 


4(1.3) 


3(1.2) 


4(1.0) 


Mathematics Education 


5(1.4) 


5 ( 2.2) 


5(1.3) 


Speciai Education 


6(1.4) 


4(1.7) 


5 ( 1.2) 


Biiinguai 


2 ( 0.8) 


6(1.5) 


2 ( 0.6) 


AdminTSupervision/Curric. 


22 ( 2.8) 


16(3.3) 


15 ( 1.8) 


Counseiing 


4(1.2) 


3(1.2) 


2 ( 0.7) 


Othar 


18(2.7) 


20 ( 4.0) 


16 (1.7) 


No graduata study 


26(3.1) 


34 ( 4.0) 


31 ( 2.4) 


GRADE 8 








Education 


41 ( 3.6) 


49 ( 5.7) 


47 ( 2.9) 


Mathamatics 


13(2.5) 


15(3.6) 


18 ( 2.4) 


Mathamatics Education 


21 ( 2.6) 


12(3.5) 


19(2.8) 


Speciai Education 


7 ( 2.0) 


1 ( 0.6) 


1 ( 0.3) 


Biiinguai 


0 (••••) 


0(0.1) 


0 (••••) 


AdminTSupervision/Curric. 


19(2.8) 


18(5.1) 


19(3.2) 


Counseiing 


4(1.0) 


6 ( 2.6) 


3(1.0) 


Othar 


20 ( 3.0) 


19(3.5) 


18 ( 2.6) 


No graduate study 


30 ( 3.2) 


26 ( 4.0) 


24 ( 2.5) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). **** Standard 
error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 
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TABLE E.4 - GRADES 4 AND 8 


Public School Teachers’ Reports on Their Teaching 
Certification 


State Assessment 



What type of teaching certification do 
you have in this state in your main 
assignment fieid? 



Colorado 


West 


Nation 


Percentage of Students 



GRADE 4 

None, Accreditation other than state, 
Temporary, or Probationary 


6(1.1) 


2 ( 0.9) 


5(1.0) 


Regular 


84 ( 2.1) 


89(3.1) 


79 ( 2.0) 


Advanced 


10 ( 1.9) 


9 ( 2.8) 


16 ( 1.8) 


GRADES 

None, Accreditation other than state. 
Temporary, or Probationary 


12 ( 2.3) 


11 (2.7) 


8(1.4) 


Regular 


78 ( 3.3) 


84 ( 2.7) 


79 ( 2.6) 


Advanced 


10(2.4) 


5(1.2) 


14(2.4) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of ^ucational Progress (NAEP), 1996 

Mathematics Assessment. 
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TABLE E.5A - GRADE 4 



Public School Teachers’ Report on Years Teaching 
Experience 



Counting this year, how many years in 


Colorado 


West 


Nation 


totai have you taught . . . 


Percentage of Students 



Af eMter the etementary or 
















secondary level 
















2 years or less 


1992. 


81 


[1.6) 


10 ( 


[1.7) 


8| 


[1.1) 




1996 


10 ( 


[1.9) 


10 ( 


[2.2) 


8| 


: 1.3) 


3-5 years 


1992 


11 ( 


[1.4) 


15 ( 


[3.2) 


131 


[1.7) 




1996 


12 ( 


[1.8) 


17 ( 


[2.9) 


14 1 


[1.6) 


6-10 years 


1992 


16 ( 


[2.0) 


13 ( 


[2.3) 


141 


[1.6) 




1996 


19 ( 


[2.2) 


27 ( 


[ 3.2)> 


23 1 


: 2.0)> 


11-24 years 


1992 


51 ( 


[2.8) 


44 1 


[3.5) 


46 1 


[2.4) 




1996 


45 1 


[3.1) 


31 ( 


[3.3) 


35 1 


: 2.6)< 


25 years or more. 


1992 


15 ( 


[1.9) 


18 ( 


[3.7) 


19 1 


[1.6) 




1996 


15 ( 


[2.1) 


15 ( 


[2.8) 


20 1 


[2.5) 


Mathematics* 
















2 years or less 


1996 


11 ( 


[2.0) 


13 ( 


[2.9) 


11 1 


[1.6) 


3-5 years 


1996 


14( 


[2.1) 


15 ( 


[3.0) 


14| 


[1.9) 


6-10 years 


1996 


21 ( 


[2.4) 


331 


[3.2) 


26 1 


[2.0) 


11-24 years 


1996 


42 ( 


[3.1) 


261 


[3.6) 


33 1 


[2.8) 


25 years or more 


1996 


13 ( 


[2.0) 


13 ( 


[2.1) 


16| 


[2.1) 



The Standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students was significantly ^gher Gower) than the value for 1992 
at al^ut the 95 percent confidence level. ♦ This question was not asked of fourth-grade teachers in 1992. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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TABLE E.5B - GRADE 8 



Public School Teachers’ Reports on Years Teaching 
Experience 





Counting this year, how many years in 
total have you taught . . . 


Colorado 


West 


Nation 


Percentage of Students 







At either the elementary or 
















secondary /eve/ 
















2 years or less 


1992 


8 1 


(1.6) 


11 { 


[2.4) 


91 


[1.6) 




1996 


10( 


(2.0) 


101 


[2.1) 


8 1 


[1.7) 


3*5 years 


1992 


13( 


(2.3) 


17< 


[3.5) 


11 4 


[1.4) 




1996 


18 ( 


(2.7) 


12 i 


[4.4) 


11 ( 


[2.2) 


6*1 0 years 


1992 


20 1 


(2.6) 


17( 


: 1.6) 


154 


[1.4) 




1996 


21 ( 


(3.1) 


28 4 


[3.8) 


194 


[2.5) 


11*24 years 


1992 


47 ( 


(3.2) 


45 4 


[2.8) 


48 4 


[2.1) 




1996 


37 ( 


(3.1) 


28 4 


: 4.3)< 


37 4 


[3.9) 


25 years or mors 


1992 


12 ( 


(2.2) 


11 4 


[2.0) 


174 


[1.7) 




1996 


14 ( 


(2.8) 


22 4 


[4.4) 


25 4 


[3.1) 


Mathenwtics 
















2 years or less 


1992 


11 ( 


(1.7) 


12 4 


[2.1) 


11 4 


[1.6) 




1996 


16( 


(2.3) 


12 4 


[2.6) 


11 4 


[1.8) 


3*5 years 


1992 


17( 


[2.4) 


18 4 


[2.9) 


144 


[1.7) 




1996 


20 1 


(2.6) 


21 4 


[5.7) 


144 


[2.1) 


6*10 years 


1992 


19( 


(2.4) 


22 4 


[2.3) 


18 4 


[1.8) 


1 


1996 


23 ( 


[3.4) 


31 1 


[4.6) 


21 4 


[2.7) 


11*24 years 


1992 


43 ( 


(3.0) 


431 


[3.6) 


444 


[2.4) 




1996 


32 1 


[3.1) 


31 1 


[4.8) 


37 4 


[3.8) 


25 years or more 


1992 


10( 


[2.0) 


8 1 


[1.4) 


134 


[1.8) 




1996 


11 1 


(2.4) 


61 


[2.3) 


174 


[2.8) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 
at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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TABLE E.6 - GRADES 4 AND 8 


Public School Teachers* Reports on Courses in Mathematics 
or Mathematics Education 


state Assessment 



Colorado 


West 


Nation 


Percentage of Students 



During the iast two years, how many 
college or university courses have you 
taken in mathematics or mathematics 
education? 



GRADE 4 








None 


54 ( 2.9) 


72 ( 4.7) 


78 ( 2.4) 


One 


24 ( 2.4) 


14 ( 2.4) 


14(1.8) 


Two 


15(2.0) 


7 ( 2.9) 


5(1.1) 


Three or more 


7(1.3) 


7 ( 3.4) 


4(1.2) 


GRADES 








None 


46 ( 3.7) 


72 ( 5.4) 


74(3.1) 


One 


21 ( 3.0) 


9 ( 2.0) 


10(2.2) 


Two 


14 ( 2.6) 


7 ( 3.8) 


5(1.3) 


Three or more 


20 ( 3.4) 


12 ( 3.3) 


1 1 ( 2.0) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 
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TABLE E.7 - GRADES 4 AND 8 



Public School Teachers* Reports on Coursework in the Use 
of Technology 



During the past five years, have you taken 
courses or participated in professional 
development activities in the use of 
technology such as computers? 



Colorado 


West 


Nation 


Percentage of Students 



GRADE 4 








Yes 


89 ( 2.0) 


85 ( 2.6) 


83 ( 1.8) 


GRADES 








Yes 


84 ( 2.5) 


81 ( 4.7) 


76 ( 2.9) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of ^ucational Progress (NAEP), 1996 

Mathematics Assessment. 
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TABLE E.8A - GRADE 4 


Public School Teachers* Reports on Studies of Mathematics 
Instruction Techniques 


state Assessment 



Have you ever studied any of the foiiowing, either 
in coiiege or university courses or in professionai 
deveiopment workshops or seminars? 



Colorado 


West 


Nation 


Percentage of Students 



Estimation 1992 

1996 


82 ( 2.3) 
79 ( 2.4) 


84 ( 3.1) 
81 ( 2.4) 


82(1.9) 

77(1.7) 


Problem solving in mathematics 1 992 

1996 


94 ( 1.1) 
93 ( 2.0) 


94 ( 1.5) 

95 ( 1.5) 


92 ( 1.3) 
90 ( 1.6) 


Use of manipulativea in mathematica instruction 1992 

1996 


93 ( 1.6) 
96(1.2) 


95 ( 1.4) 
97 ( 0.9) 


93 ( 1.0) 
91 ( 1.2) 


Use of calculators in mathematica Instruction 1992 

1996 


65 ( 2.9) 
70 ( 2.6) 


63 ( 2.7) 
72 ( 3.6) 


60 ( 2.7) 
72(2.1)> 


Understanding atudenta’ thinking about math 1992 

1996 


73 ( 2.8) 
75 ( 2.3) 


74 ( 2.8) 
77(2.1) 


72(2.1) 
71 (1.9) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 
at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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TABLE E.8B - GRADE 8 



Public School Teachers* Reports on Studies of Mathematics 
Instruction Techniques 



Have you ever studied any of the foiiowing, either 
in coiiege or university courses or in professionai 
deveiopment workshops or seminars? 



Colorado 


West 


Nation 


Percentage of Students 



Estimation 


1992 


75 


(2.7) 


81 1 


(3.0) 


79( 


(2.2) 




1996 


75 


(2.2) 


76 ( 


(4.9) 


77 ( 


(2.4) 


Problem solving In mathematics 


1992 


95 


(1.1) 


93 1 


(2.5) 


94 1 


(1.2) 




1996 


93 


(1.9) 


96 1 


(2.2) 


94 1 


(1.9) 


Use of manipulativea In mathematica Instruction 


1992 


85 


(2.1) 


90 1 


(2.4) 


90| 


(1.6) 




1996 


89 


(2.3) 


92 1 


( 2.6) 


89 1 


(2.3) 


Use of calculators In mathematica Instruction 


1992 


69 


(2.8) 


82 1 


(2.8) 


77 ( 


(2.7) 




1996 


80 


(2.4)> 


84( 


(3.1) 


801 


(2.7) 


Understanding students' thinking about math 


1992 


66 


(3.2) 


651 


(2.0) 


661 


(2.6) 




1996 


63 


(3.7) 


69 1 


(4.8) 


72 ( 


(2.6) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 
at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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TABLE E.9A - GRADE 4 



1998 



S: 



state Assessment 



Public School Teachers* Reports on Studies of Gender and 
Cultural Issues 



Have you ever studied any of the 
following, either in college or 
university courses or in professional 
development workshops or seminars? 



Colorado 


West 


Nation 


Percentage of Students 



Gender issues in the teaching 
of mathematics 


1992 


46 ( 2.7) 


41 ( 4.0) 


33 ( 2.4) 




1996 


54 ( 3.2) 


51 ( 2.8) 


46 ( 2.5)> 


Teaching atudents from different 
cultural backgrounda 


1992 


52 ( 2.6) 


51 ( 4.3) 


43 ( 2.5) 




1996 


53 ( 3.4) 


62 ( 4.6) 


50 ( 2.7) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 
at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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State Assessment 



TABLE E.9B - GRADE 8 



Public School Teachers* Reports on Studies of Gender and 
Cultural Issues 



Have you ever studied any of the 
foiiowing, either in college or 
university courses or in professional 
development workshops or seminars? 



Colorado 


West 


Nation 


Percentage of Students 



Gender Issues In the teaching 
of mathematics 


1992 


54(3.1) 


43 ( 4.6) 


42 ( 2.7) 




1996 


60 ( 3.3) 


54 ( 6.3) 


48 ( 3.4) 


Teaching atudents from different 
cuhural backgrounda 


1992 


55 ( 2.9) 


58 ( 3.5) 


51 ( 2.4) 




1996 


54 ( 3.6) 


65 ( 6.3) 


52 ( 3.0) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 
at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992 and 
1996 Mathematics Assessments. 
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TABLE E.10 — GRADES 4 mU 8 



Public School Teachers’ Reports on Professional 
Development 



Colorado 


West 


Nation 


Percentage of Students 



During the fast year, how much time in 
totai have you spent in professionai 
deveiopment workshops or seminars in 
mathematics or mathematics education? 



GRADE 4 








None 


21 ( 2.5) 


12(3.1) 


15(2.1) 


Less than 6 hours 


28 ( 2.9) 


20 ( 3.7) 


29 ( 2.2) 


6-15 hours 


30 ( 2.7) 


31 ( 4.4) 


28 ( 2.4) 


16-35 hours 


11 ( 2.2) 


17(3.8) 


15 (2.0) 


More than 35 hours 


10 ( 1.9) 


19(3.3) 


13 ( 1.6) 


GRADE 8 








None 


7 ( 2.3) 


4 ( 2.3) 


5(1.2) 


Less than 6 hours 


21 ( 2.6) 


7 ( 2.6) 


19 ( 3.1) 


6-15 hours 


29 ( 3.3) 


20 ( 3.9) 


28 ( 2.7) 


16-35 hours 


22 ( 3.3) 


26 ( 4.6) 


21 ( 2.6) 


More than 35 hours 


20 ( 3.1) 


43 ( 5.4) 


27 ( 2.9) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of ^ucational Progress (NAEP), 1996 
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APPENDIX F 



Discussion of the Grade 8 Asian/Pacific 
Islander Sample 



A 

jlVs noted in Chapters 2 and 4, national and regional scale score and 
achievement level results for eighth-grade Asian/Pacific Islander students are not 
included in the main body of this report. The decision to present these results in a 
separate appendix was made following a thorough investigation by the current NAEP 
grantees (Westat and ETS)’ into the quality and credibility of these results, as well as 
an independent review by a committee of statisticians from the National Institute of 
Statistical Sciences (NISS).^ Collateral results from the grade 8 state assessment 
program in mathematics suggested that the 1996 national results may substantially 
underestimate actual achievement of the Asian/Pacific Islander group. Because of its 
potential to misinform, NCES decided to omit the national grade 8 Asian/Pacific Islander 
results from the body of the report. The results are, however, included in this appendix 
along with a description of the findings that led to this decision. 

Concerns about the accuracy of the national grade 8 Asian/Pacific Islander results 
were initially noted during routine quality control of the NAEP 1996 mathematics 
results. Despite statistically significant gains from 1992 to 1996 in average scale scores 
for the nation as a whole at all three grade levels, a large apparent decline in average 
scores was observed for the grade 8 Asian/Pacific Islander subgroup. Table F.l contains 
national average mathematics scale score estimates, and their standard errors, for the 
Asian/Pacific Islander subgroup for the 1990, 1992 and 1996 assessment years. From 
1992 to 1996, the estimated decline in average scores for this subgroup was 
approximately 14 scale score points (about .4 within-grade standard deviation units) on 
the NAEP 500-point scale. Despite the large magnitude of this apparent decline, it is 
not statistically significant at the .05 level, after controlling for multiple comparisons. 



Carlson, J. and P. Williams. ETS/NAEP Technical Memorandum on 1996 Mathematics Grade 8 results for Asian/Pacific 
Islander Subpopulation. (October 29, 1996); Rust, K. Westat Memorandum to Gary Phillips on 1996 Mathematics 
Grade 8 Results for Asian and Pacific Islander Students. (November 1, 1996). 

^ Letter from Jerome Sacks to Gary Phillips, dated November 21, 1996. 
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TABLE F.1 


-1 


Average Mathematics Scale Scores for the Grade 8 


State Assessment 


Asian/Pacific Islander Subgroup 



1990 


1992 


1996 


Percentage 


Average 
Scale Score 


Percentage 


Average 
Scale Score 


Percentage 


Average 
Scale Score 



All students 


100 


263 (1.3) 


100 


268 (0.9)» 


100 


272 (1.1 )»> 


Students who indicated 
their Race/Ethnicity as... 

Aslan/Pacific Islander 


2 ( 0 . 5)1 


279 ( 4 . 8)1 


3 ( 0 . 2 ) 


: 280 ( 5 . 4 ) 


3 ( 0 . 2 ) 


274 ( 3 . 9 ) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can 
be said with about 95 percent confidence that, for each population of interest, the value for the entire population is within 
± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (sec Appendix A for details). If the notation » («) appears, it signifies that the value for public school students 
was significantly higher (lower) than the value for 1990 at about the 95 percent confidence level. If the notation > (<) 
appears, it signifies that the value for public school students was significantly higher (lower) than the value for 1992 at 
about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1990, 1992, 
and 1996 Mathematics Assessments. 



The data from the NAEP state assessment program in mathematics provided an 
independent data source to aid in evaluating the accuracy of the national grade 8 NAEP 
results for Asian/Pacific Islander students as well as for other subgroups. Forty states 
and the District of Columbia participated in the state assessment. Results based on the 
combined data from these jurisdictions are quite stable in that they are based on a sample 
of approximately 4,000 schools and over 100,000 students. Because of the voluntary 
nature of the state assessment program, these aggregated state results are not nationally 
representative. They can, however, be compared to restricted national results, calculated 
using public-school data from only those states participating in the state assessment, to 
obtain valuable insight into the quality of the national estimates for the grade 8 
race/ethnicity subgroups. 

Table F.2 contains restricted national results. Results are presented separately for 
four of the race/ethnicity subgroups: White, Black, Hispanic, and Asian/Pacific Islander. 
Aggregated state results are also presented for these same four subgroups. For three of 
the four subgroups, the difference between the restricted national estimates and 
aggregated state estimates are quite small. However, for the Asian/Pacific subgroup, the 
difference between the two estimates, though again within reasonable bounds of 
sampling variability, is of considerably greater magnitude and the restricted national 
estimates are substantially lower than those obtained from the aggregated state data. 
These results suggest that the national grade 8 Asian/Pacific Islander results may 
substantially underestimate the performance of this subgroup. NCES was concerned that 
publishing the national results in the absence of the kind of discussion included in this 
appendix was potentially misinforming. Hence, they made the decision to omit the 
results from the body of the report and to include them in this appendix. 
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TABLE F.2 


Average Mathematics Scale Scores by Race/Ethnicity for 


State Assessment 


Restricted National and Aggregated State Samples 



Restricted National 
Sample 


Aggregated State 
Sample 


Difference 



Grade 8 

Students who indicated 
their Race/Ethnicity as... 

White 


280.7 


280.0 


0.7 


Black 


242.8 


242.3 


0.5 


Hispanic 


250.4 


250.3 


0.1 


Aslan/Pacific Islander 


272.0 


281.7 


-9.7 



SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 

Mathematics Assessment. 



It is important to note that all NAEP results are estimates and are subject to some 
degree of sampling variability. If different samples of schools or students had been 
obtained, results for some subgroups would be higher than reported here and some would 
be lower. In most subgroups, particularly large subgroups or subgroups for which 
special sampling procedures are employed, estimates of performance are likely to remain 
similar from one sample to another. However, the national population of Asian/Pacific 
Islander students is small (about 3 percent of the national population), heterogeneous 
with respect to academic achievement, and highly clustered in certain locations and 
schools — factors which are associated with large sampling variability in survey results 
and reflected in the large standard errors associated with performance estimates for this 
subgroup. Furthermore, the sampling plan for the national assessment does not include 
explicit stratification procedures designed to mitigate these factors. It was the judgment 
of all three organizations (ETS, Westat, and MISS) that investigated these results that the 
occurrence of this large, but statistically nonsignificant, change in the grade 8 
Asian/Pacific Islander results was a consequence of these three factors: (1) the 
heterogeneous nature of the Asian/Pacific Islander population, (2) the current NAEP 
sampling design, and, (3) the sample sizes that were assessed. 

NCES, working with its current NAEP contractors and other advisory groups, will 
continue to investigate cost-effective ways of improving the accuracy and stability of 
NAEP results beginning with the 1998 assessment. They will also continue to seek 
improvements as part of an ongoing redesign of NAEP for the year 2000 and beyond. 
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